Apr 12 00:25:35 user nova-compute[82394]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 00:25:37 user nova-compute[82394]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82394) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 00:25:37 user nova-compute[82394]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82394) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 00:25:37 user nova-compute[82394]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82394) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 00:25:37 user nova-compute[82394]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 00:25:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:25:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:25:37 user nova-compute[82394]: INFO nova.virt.driver [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 00:25:38 user nova-compute[82394]: INFO nova.compute.provider_config [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Acquiring lock "singleton_lock" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Acquired lock "singleton_lock" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Releasing lock "singleton_lock" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Full set of CONF: {{(pid=82394) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ******************************************************************************** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Configuration options gathered from: {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ================================================================================ {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] allow_resize_to_same_host      = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] arq_binding_timeout            = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] backdoor_port                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] backdoor_socket                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] block_device_allocate_retries  = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] block_device_allocate_retries_interval = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cert                           = self.pem {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute_monitors               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] config_dir                     = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] config_drive_format            = iso9660 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] config_source                  = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] console_host                   = user {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] control_exchange               = nova {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cpu_allocation_ratio           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] daemon                         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] debug                          = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] default_access_ip_network_name = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] default_availability_zone      = nova {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] default_ephemeral_format       = ext4 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] default_schedule_zone          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] disk_allocation_ratio          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] enable_new_services            = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] enabled_ssl_apis               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] flat_injected                  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] force_config_drive             = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] force_raw_images               = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] graceful_shutdown_timeout      = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] heal_instance_info_cache_interval = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] host                           = user {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_build_timeout         = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_delete_interval       = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_name_template         = instance-%08x {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_usage_audit           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_usage_audit_period    = month {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] internal_service_availability_zone = internal {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] key                            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] live_migration_retry_count     = 30 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_config_append              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_dir                        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_file                       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_options                    = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_rotate_interval            = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_rotate_interval_type       = days {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] log_rotation_type              = none {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] long_rpc_timeout               = 1800 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_concurrent_builds          = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_concurrent_live_migrations = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_concurrent_snapshots       = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_local_block_devices        = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_logfile_count              = 30 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] max_logfile_size_mb            = 200 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] maximum_instance_delete_attempts = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metadata_listen                = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metadata_listen_port           = 8775 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metadata_workers               = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] migrate_max_retries            = -1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] mkisofs_cmd                    = genisoimage {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] my_ip                          = 10.0.0.210 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] network_allocate_retries       = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] osapi_compute_listen_port      = 8774 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] osapi_compute_unique_server_name_scope =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] osapi_compute_workers          = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] password_length                = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] periodic_enable                = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] periodic_fuzzy_delay           = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] pointer_model                  = ps2mouse {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] preallocate_images             = none {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] publish_errors                 = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] pybasedir                      = /opt/stack/nova {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ram_allocation_ratio           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rate_limit_burst               = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rate_limit_except_level        = CRITICAL {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rate_limit_interval            = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reboot_timeout                 = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reclaim_instance_interval      = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] record                         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reimage_timeout_per_gb         = 20 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] report_interval                = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rescue_timeout                 = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reserved_host_cpus             = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reserved_host_disk_mb          = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reserved_host_memory_mb        = 512 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] reserved_huge_pages            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] resize_confirm_window          = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] resize_fs_using_block_device   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] resume_guests_state_on_host_boot = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rpc_response_timeout           = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] run_external_periodic_tasks    = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] running_deleted_instance_action = reap {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] running_deleted_instance_timeout = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler_instance_sync_interval = 120 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_down_time              = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] servicegroup_driver            = db {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] shelved_offload_time           = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] shelved_poll_interval          = 3600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] shutdown_timeout               = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] source_is_ipv6                 = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ssl_only                       = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] state_path                     = /opt/stack/data/nova {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] sync_power_state_interval      = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] sync_power_state_pool_size     = 1000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] syslog_log_facility            = LOG_USER {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] tempdir                        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] timeout_nbd                    = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] transport_url                  = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] update_resources_interval      = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_cow_images                 = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_eventlog                   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_journal                    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_json                       = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_rootwrap_daemon            = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_stderr                     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] use_syslog                     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vcpu_pin_set                   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plugging_is_fatal          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plugging_timeout           = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] virt_mkfs                      = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] volume_usage_poll_interval     = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] watch_log_file                 = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] web                            = /usr/share/spice-html5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.auth_strategy              = keystone {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.compute_link_prefix        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.dhcp_domain                = novalocal {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.enable_instance_password   = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.glance_link_prefix         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.instance_list_per_project_cells = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.list_records_by_skipping_down_cells = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.local_metadata_per_cell    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.max_limit                  = 1000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.metadata_cache_expiration  = 15 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.neutron_default_tenant_id  = default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.use_forwarded_for          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.use_neutron_default_nets   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_dynamic_targets = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_jsonfile_path   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.backend_argument         = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.config_prefix            = cache.oslo {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.dead_timeout             = 60.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.debug_cache_backend      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.enable_retry_client      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.enable_socket_keepalive  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.enabled                  = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.expiration_time          = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_dead_retry      = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_password        =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_sasl_enabled    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.memcache_username        =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.proxies                  = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.retry_attempts           = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.retry_delay              = 0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.socket_keepalive_count   = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.socket_keepalive_idle    = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.socket_keepalive_interval = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.tls_allowed_ciphers      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.tls_cafile               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.tls_certfile             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.tls_enabled              = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cache.tls_keyfile              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.auth_section            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.auth_type               = password {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.cafile                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.certfile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.collect_timing          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.cross_az_attach         = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.debug                   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.endpoint_template       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.http_retries            = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.insecure                = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.keyfile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.os_region_name          = RegionOne {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.split_loggers           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cinder.timeout                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.cpu_dedicated_set      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.cpu_shared_set         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.image_type_exclude_list = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.resource_provider_association_refresh = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.shutdown_retry_interval = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] conductor.workers              = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] console.allowed_origins        = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] console.ssl_ciphers            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] console.ssl_minimum_version    = default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] consoleauth.token_ttl          = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.cafile                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.certfile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.collect_timing          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.connect_retries         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.connect_retry_delay     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.endpoint_override       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.insecure                = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.keyfile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.max_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.min_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.region_name             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.service_name            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.service_type            = accelerator {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.split_loggers           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.status_code_retries     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.timeout                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] cyborg.version                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.backend               = sqlalchemy {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.connection            = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.connection_debug      = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.connection_parameters =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.connection_recycle_time = 3600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.connection_trace      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.db_inc_retry_interval = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.db_max_retries        = 20 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.db_max_retry_interval = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.db_retry_interval     = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.max_overflow          = 50 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.max_pool_size         = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.max_retries           = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.mysql_enable_ndb      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.pool_timeout          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.retry_interval        = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.slave_connection      = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] database.sqlite_synchronous    = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.backend           = sqlalchemy {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.connection        = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.connection_debug  = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.connection_parameters =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.connection_recycle_time = 3600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.connection_trace  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.db_inc_retry_interval = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.db_max_retries    = 20 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.db_max_retry_interval = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.db_retry_interval = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.max_overflow      = 50 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.max_pool_size     = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.max_retries       = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.mysql_enable_ndb  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.pool_timeout      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.retry_interval    = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.slave_connection  = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] api_database.sqlite_synchronous = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] devices.enabled_mdev_types     = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ephemeral_storage_encryption.enabled = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.api_servers             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.cafile                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.certfile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.collect_timing          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.connect_retries         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.connect_retry_delay     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.debug                   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.default_trusted_certificate_ids = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.enable_certificate_validation = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.enable_rbd_download     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.endpoint_override       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.insecure                = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.keyfile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.max_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.min_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.num_retries             = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.rbd_ceph_conf           =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.rbd_connect_timeout     = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.rbd_pool                =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.rbd_user                =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.region_name             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.service_name            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.service_type            = image {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.split_loggers           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.status_code_retries     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.timeout                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.verify_glance_signatures = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] glance.version                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] guestfs.debug                  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.config_drive_cdrom      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.config_drive_inject_password = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.enable_remotefx         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.instances_path_share    =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.limit_cpu_features      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.use_multipath_io        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.vswitch_name            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] mks.enabled                    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.manager_interval   = 2400 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.precache_concurrency = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.remove_unused_base_images = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] image_cache.subdirectory_name  = _base {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.api_max_retries         = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.api_retry_interval      = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.auth_section            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.auth_type               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.cafile                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.certfile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.collect_timing          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.connect_retries         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.connect_retry_delay     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.endpoint_override       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.insecure                = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.keyfile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.max_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.min_version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.partition_key           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.peer_list               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.region_name             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.serial_console_state_timeout = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.service_name            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.service_type            = baremetal {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.split_loggers           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.status_code_retries     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.timeout                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ironic.version                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] key_manager.fixed_key          = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.barbican_api_version  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.barbican_endpoint     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.barbican_endpoint_type = public {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.barbican_region_name  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.cafile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.certfile              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.collect_timing        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.insecure              = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.keyfile               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.number_of_retries     = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.retry_delay           = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.send_service_user_token = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.split_loggers         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.timeout               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.verify_ssl            = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican.verify_ssl_path       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.auth_section = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.auth_type = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.cafile   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.certfile = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.collect_timing = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.insecure = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.keyfile  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.split_loggers = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] barbican_service_user.timeout  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.approle_role_id          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.approle_secret_id        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.cafile                   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.certfile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.collect_timing           = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.insecure                 = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.keyfile                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.kv_mountpoint            = secret {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.kv_version               = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.namespace                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.root_token_id            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.split_loggers            = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.ssl_ca_crt_file          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.timeout                  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.use_ssl                  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.cafile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.certfile              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.collect_timing        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.connect_retries       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.connect_retry_delay   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.endpoint_override     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.insecure              = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.keyfile               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.max_version           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.min_version           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.region_name           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.service_name          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.service_type          = identity {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.split_loggers         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.status_code_retries   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.timeout               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] keystone.version               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.connection_uri         =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_mode               = custom {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: WARNING oslo_config.cfg [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_power_governor_high = performance {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_power_management   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.device_detach_attempts = 8 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.device_detach_timeout  = 20 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.disk_cachemodes        = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.disk_prefix            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.enabled_perf_events    = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.file_backed_memory     = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.gid_maps               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.hw_disk_discard        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.hw_machine_type        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_rbd_pool        = rbd {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_type            = default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.images_volume_group    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.inject_key             = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.inject_partition       = -2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.inject_password        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.iscsi_iface            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.iser_use_multipath     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_downtime = 500 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_inbound_addr = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_scheme  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_timeout_action = abort {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_tunnelled = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: WARNING oslo_config.cfg [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 00:25:38 user nova-compute[82394]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 00:25:38 user nova-compute[82394]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 00:25:38 user nova-compute[82394]: and ``live_migration_inbound_addr`` respectively.
Apr 12 00:25:38 user nova-compute[82394]: ).  Its value may be silently ignored in the future.
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.live_migration_with_native_tls = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.max_queues             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.nfs_mount_options      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_pcie_ports         = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.pmem_namespaces        = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.quobyte_client_cfg     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rbd_secret_uuid        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rbd_user               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rescue_image_id        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rescue_kernel_id       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.rx_queue_size          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.smbfs_mount_options    =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.snapshot_compression   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.snapshot_image_format  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.sparse_logical_volumes = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.swtpm_enabled          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.swtpm_group            = tss {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.swtpm_user             = tss {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.sysinfo_serial         = unique {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.tx_queue_size          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.uid_maps               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.use_virtio_for_bridges = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.virt_type              = kvm {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.volume_clear           = zero {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.volume_clear_size      = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.volume_use_multipath   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_cache_path   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.auth_section           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.auth_type              = password {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.cafile                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.certfile               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.collect_timing         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.connect_retries        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.connect_retry_delay    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.default_floating_pool  = public {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.endpoint_override      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.extension_sync_interval = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.http_retries           = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.insecure               = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.keyfile                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.max_version            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.min_version            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.ovs_bridge             = br-int {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.physnets               = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.region_name            = RegionOne {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.service_metadata_proxy = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.service_name           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.service_type           = network {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.split_loggers          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.status_code_retries    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.timeout                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] neutron.version                = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] notifications.bdms_in_notifications = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] notifications.default_level    = INFO {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] notifications.notification_format = unversioned {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] notifications.notify_on_state_change = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] pci.alias                      = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] pci.device_spec                = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] pci.report_in_placement        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.auth_section         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.auth_type            = password {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.cafile               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.certfile             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.collect_timing       = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.connect_retries      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.connect_retry_delay  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.default_domain_id    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.default_domain_name  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.domain_id            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.domain_name          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.endpoint_override    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.insecure             = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.keyfile              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.max_version          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.min_version          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.password             = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.project_domain_id    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.project_domain_name  = Default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.project_id           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.project_name         = service {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.region_name          = RegionOne {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.service_name         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.service_type         = placement {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.split_loggers        = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.status_code_retries  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.system_scope         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.timeout              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.trust_id             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.user_domain_id       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.user_domain_name     = Default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.user_id              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.username             = placement {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] placement.version              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.cores                    = 20 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.count_usage_from_placement = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.injected_file_content_bytes = 10240 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.injected_file_path_length = 255 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.injected_files           = 5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.instances                = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.key_pairs                = 100 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.metadata_items           = 128 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.ram                      = 51200 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.recheck_quota            = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.server_group_members     = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] quota.server_groups            = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rdp.enabled                    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.image_metadata_prefilter = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.max_attempts         = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.max_placement_results = 1000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] scheduler.workers              = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.host_subset_size = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.isolated_hosts = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.isolated_images = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.pci_in_placement = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.track_instance_changes = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metrics.required               = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metrics.weight_multiplier      = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] metrics.weight_setting         = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.enabled         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.port_range      = 10000:20000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] serial_console.serialproxy_port = 6083 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.auth_section      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.auth_type         = password {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.cafile            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.certfile          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.collect_timing    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.insecure          = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.keyfile           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.send_service_user_token = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.split_loggers     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] service_user.timeout           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.agent_enabled            = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.enabled                  = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.html5proxy_port          = 6082 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.image_compression        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.jpeg_compression         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.playback_compression     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.server_listen            = 127.0.0.1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.streaming_mode           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] spice.zlib_compression         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] upgrade_levels.baseapi         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] upgrade_levels.cert            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] upgrade_levels.compute         = auto {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] upgrade_levels.conductor       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] upgrade_levels.scheduler       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.cafile = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.certfile = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.insecure = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vendordata_dynamic_auth.timeout = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.api_retry_count         = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.ca_file                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.cache_prefix            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.cluster_name            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.connection_pool_size    = 10 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.console_delay_seconds   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.datastore_regex         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.host_ip                 = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.host_password           = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.host_port               = 443 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.host_username           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.insecure                = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.integration_bridge      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.maximum_objects         = 100 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.pbm_default_policy      = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.pbm_enabled             = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.pbm_wsdl_location       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.serial_port_proxy_uri   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.serial_port_service_uri = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.task_poll_interval      = 0.5 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.use_linked_clone        = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.vnc_keymap              = en-us {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.vnc_port                = 5900 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vmware.vnc_port_total          = 10000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.auth_schemes               = ['none'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.enabled                    = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.novncproxy_port            = 6080 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.vencrypt_ca_certs          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.vencrypt_client_cert       = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vnc.vencrypt_client_key        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.disable_rootwrap   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.enable_numa_live_migration = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.libvirt_disable_apic = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.client_socket_timeout     = 900 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.default_pool_size         = 1000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.keep_alive                = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.max_header_line           = 16384 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.ssl_ca_file               = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.ssl_cert_file             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.ssl_key_file              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.tcp_keepidle              = 600 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] zvm.ca_file                    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] zvm.cloud_connector_url        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] zvm.reachable_timeout          = 300 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.enforce_scope      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.policy_default_rule = default {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.connection_string     = messaging:// {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.enabled               = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.es_doc_type           = notification {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.es_scroll_size        = 10000 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.es_scroll_time        = 2m {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.filter_error_trace    = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.sentinel_service_name = mymaster {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.socket_timeout        = 0.1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] profiler.trace_sqlalchemy      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] remote_debug.host              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] remote_debug.port              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.auth_section        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.auth_type           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.cafile              = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.certfile            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.collect_timing      = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.connect_retries     = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.connect_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.endpoint_id         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.endpoint_override   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.insecure            = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.keyfile             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.max_version         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.min_version         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.region_name         = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.service_name        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.service_type        = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.split_loggers       = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.status_code_retries = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.status_code_retry_delay = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.timeout             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.valid_interfaces    = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_limit.version             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_reports.file_event_handler = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] oslo_reports.log_dir           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.group  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] vif_plug_ovs_privileged.user   = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.isolate_vif         = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] os_brick.lock_path             = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.capabilities   = [21] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.group          = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.helper_command = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] privsep_osbrick.user           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.group           = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.helper_command  = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] nova_sys_admin.user            = None {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG oslo_service.service [None req-978f0e4c-48c4-4909-a780-e3d26410f2c8 None None] ******************************************************************************** {{(pid=82394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 00:25:38 user nova-compute[82394]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Starting native event thread {{(pid=82394) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Starting green dispatch thread {{(pid=82394) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Starting connection event dispatch thread {{(pid=82394) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Connecting to libvirt: qemu:///system {{(pid=82394) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb23bbb2650> {{(pid=82394) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb23bbb2650> {{(pid=82394) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 00:25:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Connection event '1' reason 'None'
Apr 12 00:25:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 00:25:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.mount [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Initialising _HostMountState generation 0 {{(pid=82394) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 00:25:45 user nova-compute[82394]: INFO nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host capabilities <capabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <host>
Apr 12 00:25:45 user nova-compute[82394]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 00:25:45 user nova-compute[82394]:     <cpu>
Apr 12 00:25:45 user nova-compute[82394]:       <arch>x86_64</arch>
Apr 12 00:25:45 user nova-compute[82394]:       <model>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <microcode version='1070'/>
Apr 12 00:25:45 user nova-compute[82394]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='osxsave'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='invtsc'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='rsba'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 00:25:45 user nova-compute[82394]:       <pages unit='KiB' size='4'/>
Apr 12 00:25:45 user nova-compute[82394]:       <pages unit='KiB' size='2048'/>
Apr 12 00:25:45 user nova-compute[82394]:     </cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <power_management>
Apr 12 00:25:45 user nova-compute[82394]:       <suspend_mem/>
Apr 12 00:25:45 user nova-compute[82394]:       <suspend_disk/>
Apr 12 00:25:45 user nova-compute[82394]:       <suspend_hybrid/>
Apr 12 00:25:45 user nova-compute[82394]:     </power_management>
Apr 12 00:25:45 user nova-compute[82394]:     <iommu support='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <migration_features>
Apr 12 00:25:45 user nova-compute[82394]:       <live/>
Apr 12 00:25:45 user nova-compute[82394]:       <uri_transports>
Apr 12 00:25:45 user nova-compute[82394]:         <uri_transport>tcp</uri_transport>
Apr 12 00:25:45 user nova-compute[82394]:         <uri_transport>rdma</uri_transport>
Apr 12 00:25:45 user nova-compute[82394]:       </uri_transports>
Apr 12 00:25:45 user nova-compute[82394]:     </migration_features>
Apr 12 00:25:45 user nova-compute[82394]:     <topology>
Apr 12 00:25:45 user nova-compute[82394]:       <cells num='2'>
Apr 12 00:25:45 user nova-compute[82394]:         <cell id='0'>
Apr 12 00:25:45 user nova-compute[82394]:           <memory unit='KiB'>8152920</memory>
Apr 12 00:25:45 user nova-compute[82394]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 12 00:25:45 user nova-compute[82394]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 00:25:45 user nova-compute[82394]:           <distances>
Apr 12 00:25:45 user nova-compute[82394]:             <sibling id='0' value='10'/>
Apr 12 00:25:45 user nova-compute[82394]:             <sibling id='1' value='20'/>
Apr 12 00:25:45 user nova-compute[82394]:           </distances>
Apr 12 00:25:45 user nova-compute[82394]:           <cpus num='6'>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 00:25:45 user nova-compute[82394]:           </cpus>
Apr 12 00:25:45 user nova-compute[82394]:         </cell>
Apr 12 00:25:45 user nova-compute[82394]:         <cell id='1'>
Apr 12 00:25:45 user nova-compute[82394]:           <memory unit='KiB'>8255068</memory>
Apr 12 00:25:45 user nova-compute[82394]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 12 00:25:45 user nova-compute[82394]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 00:25:45 user nova-compute[82394]:           <distances>
Apr 12 00:25:45 user nova-compute[82394]:             <sibling id='0' value='20'/>
Apr 12 00:25:45 user nova-compute[82394]:             <sibling id='1' value='10'/>
Apr 12 00:25:45 user nova-compute[82394]:           </distances>
Apr 12 00:25:45 user nova-compute[82394]:           <cpus num='6'>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 00:25:45 user nova-compute[82394]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 00:25:45 user nova-compute[82394]:           </cpus>
Apr 12 00:25:45 user nova-compute[82394]:         </cell>
Apr 12 00:25:45 user nova-compute[82394]:       </cells>
Apr 12 00:25:45 user nova-compute[82394]:     </topology>
Apr 12 00:25:45 user nova-compute[82394]:     <cache>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 00:25:45 user nova-compute[82394]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 00:25:45 user nova-compute[82394]:     </cache>
Apr 12 00:25:45 user nova-compute[82394]:     <secmodel>
Apr 12 00:25:45 user nova-compute[82394]:       <model>apparmor</model>
Apr 12 00:25:45 user nova-compute[82394]:       <doi>0</doi>
Apr 12 00:25:45 user nova-compute[82394]:     </secmodel>
Apr 12 00:25:45 user nova-compute[82394]:     <secmodel>
Apr 12 00:25:45 user nova-compute[82394]:       <model>dac</model>
Apr 12 00:25:45 user nova-compute[82394]:       <doi>0</doi>
Apr 12 00:25:45 user nova-compute[82394]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 00:25:45 user nova-compute[82394]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 00:25:45 user nova-compute[82394]:     </secmodel>
Apr 12 00:25:45 user nova-compute[82394]:   </host>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='alpha'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>clipper</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='armv6l'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>spitz</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>nuri</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>kzm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>z2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>tosa</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n810</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>terrier</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>midway</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>microbit</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>verdex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>highbank</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>akita</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>connex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>collie</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='armv7l'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>spitz</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>nuri</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>kzm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>z2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>tosa</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n810</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>terrier</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>midway</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>microbit</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>verdex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>highbank</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>akita</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>connex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>collie</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='aarch64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>spitz</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>nuri</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>kzm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>z2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>tosa</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n810</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>n800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>terrier</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>midway</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>microbit</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>verdex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>highbank</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>akita</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>connex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>collie</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <acpi default='on' toggle='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='cris'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='i686'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>isapc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>microvm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='kvm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <pae/>
Apr 12 00:25:45 user nova-compute[82394]:       <nonpae/>
Apr 12 00:25:45 user nova-compute[82394]:       <acpi default='on' toggle='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:       <apic default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='m68k'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>an5206</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>q800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='microblaze'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='microblazeel'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='mips'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>malta</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='mipsel'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>malta</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='mips64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>malta</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>pica61</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>magnum</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='mips64el'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>malta</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>pica61</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>magnum</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='16'>boston</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='ppc'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mac99</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>40p</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>taihu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='ppc64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>taihu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>40p</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mac99</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='ppc64le'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>taihu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>40p</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>mac99</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='riscv32'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='8'>spike</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='8'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='riscv64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='8'>spike</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='8'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='s390x'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='sh4'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>shix</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>r2d</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='sh4eb'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>shix</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>r2d</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='sparc'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>LX</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='sparc64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>niagara</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='x86_64'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>64</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='1'>isapc</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>microvm</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='kvm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <acpi default='on' toggle='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:       <apic default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='xtensa'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>sim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>kc705</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ml605</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx200</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx60</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]:   <guest>
Apr 12 00:25:45 user nova-compute[82394]:     <os_type>hvm</os_type>
Apr 12 00:25:45 user nova-compute[82394]:     <arch name='xtensaeb'>
Apr 12 00:25:45 user nova-compute[82394]:       <wordsize>32</wordsize>
Apr 12 00:25:45 user nova-compute[82394]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='4'>sim</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>kc705</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ml605</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>virt</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx200</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>lx60</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 00:25:45 user nova-compute[82394]:       <domain type='qemu'/>
Apr 12 00:25:45 user nova-compute[82394]:     </arch>
Apr 12 00:25:45 user nova-compute[82394]:     <features>
Apr 12 00:25:45 user nova-compute[82394]:       <cpuselection/>
Apr 12 00:25:45 user nova-compute[82394]:       <deviceboot/>
Apr 12 00:25:45 user nova-compute[82394]:       <disksnapshot default='on' toggle='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     </features>
Apr 12 00:25:45 user nova-compute[82394]:   </guest>
Apr 12 00:25:45 user nova-compute[82394]: </capabilities>
Apr 12 00:25:45 user nova-compute[82394]: 
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-q35-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>i686</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='288'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'/>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='lm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-i440fx-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>i686</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='255'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'/>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='lm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ide</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-q35-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>i686</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='288'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'/>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='lm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-i440fx-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>i686</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='255'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'/>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='lm'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ide</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-q35-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>x86_64</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='288'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>efi</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='invtsc'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='rsba'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-i440fx-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>x86_64</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='255'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>efi</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='invtsc'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='rsba'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ide</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-q35-jammy</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>x86_64</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='288'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>efi</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='invtsc'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='rsba'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 00:25:45 user nova-compute[82394]: <domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 00:25:45 user nova-compute[82394]:   <domain>kvm</domain>
Apr 12 00:25:45 user nova-compute[82394]:   <machine>pc-i440fx-6.2</machine>
Apr 12 00:25:45 user nova-compute[82394]:   <arch>x86_64</arch>
Apr 12 00:25:45 user nova-compute[82394]:   <vcpu max='255'/>
Apr 12 00:25:45 user nova-compute[82394]:   <iothreads supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:   <os supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='firmware'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>efi</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:     <loader supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>rom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pflash</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='readonly'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>yes</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='secure'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>no</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </loader>
Apr 12 00:25:45 user nova-compute[82394]:   </os>
Apr 12 00:25:45 user nova-compute[82394]:   <cpu>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-passthrough' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='hostPassthroughMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='maximum' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='maximumMigratable'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>on</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>off</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='host-model' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <vendor>Intel</vendor>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ss'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='vmx'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pcid'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='hypervisor'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arat'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='umip'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='md-clear'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='invtsc'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibpb'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='ibrs'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-stibp'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='rsba'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='erms'/>
Apr 12 00:25:45 user nova-compute[82394]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:     <mode name='custom' supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>qemu64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>qemu32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>phenom</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>pentium</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>n270</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm64</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>kvm32</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>coreduo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>core2duo</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>athlon</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Westmere</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Snowridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Skylake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>SandyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Penryn</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G5</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G4</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G3</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Opteron_G2</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Opteron_G1</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>IvyBridge</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Icelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Haswell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Rome</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-Milan</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>EPYC</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Dhyana</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cooperlake</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>Conroe</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='no'>Broadwell</model>
Apr 12 00:25:45 user nova-compute[82394]:       <model usable='yes'>486</model>
Apr 12 00:25:45 user nova-compute[82394]:     </mode>
Apr 12 00:25:45 user nova-compute[82394]:   </cpu>
Apr 12 00:25:45 user nova-compute[82394]:   <memoryBacking supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:     <enum name='sourceType'>
Apr 12 00:25:45 user nova-compute[82394]:       <value>file</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>anonymous</value>
Apr 12 00:25:45 user nova-compute[82394]:       <value>memfd</value>
Apr 12 00:25:45 user nova-compute[82394]:     </enum>
Apr 12 00:25:45 user nova-compute[82394]:   </memoryBacking>
Apr 12 00:25:45 user nova-compute[82394]:   <devices>
Apr 12 00:25:45 user nova-compute[82394]:     <disk supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='diskDevice'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>disk</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cdrom</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>floppy</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>lun</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='bus'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ide</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>fdc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sata</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </disk>
Apr 12 00:25:45 user nova-compute[82394]:     <graphics supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='type'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>sdl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vnc</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>spice</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egl-headless</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </graphics>
Apr 12 00:25:45 user nova-compute[82394]:     <video supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='modelType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>cirrus</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>vmvga</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>qxl</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>none</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>bochs</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>ramfb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </video>
Apr 12 00:25:45 user nova-compute[82394]:     <hostdev supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='mode'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>subsystem</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='startupPolicy'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>default</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>mandatory</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>requisite</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>optional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='subsysType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>usb</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>pci</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>scsi</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='capsType'/>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='pciBackend'/>
Apr 12 00:25:45 user nova-compute[82394]:     </hostdev>
Apr 12 00:25:45 user nova-compute[82394]:     <rng supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtio-non-transitional</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>random</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>egd</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>builtin</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </rng>
Apr 12 00:25:45 user nova-compute[82394]:     <filesystem supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='driverType'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>path</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>handle</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>virtiofs</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </filesystem>
Apr 12 00:25:45 user nova-compute[82394]:     <tpm supported='yes'>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='model'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-tis</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>tpm-crb</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:       <enum name='backendModel'>
Apr 12 00:25:45 user nova-compute[82394]:         <value>passthrough</value>
Apr 12 00:25:45 user nova-compute[82394]:         <value>emulator</value>
Apr 12 00:25:45 user nova-compute[82394]:       </enum>
Apr 12 00:25:45 user nova-compute[82394]:     </tpm>
Apr 12 00:25:45 user nova-compute[82394]:   </devices>
Apr 12 00:25:45 user nova-compute[82394]:   <features>
Apr 12 00:25:45 user nova-compute[82394]:     <gic supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:     <vmcoreinfo supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <genid supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backingStoreInput supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <backup supported='yes'/>
Apr 12 00:25:45 user nova-compute[82394]:     <sev supported='no'/>
Apr 12 00:25:45 user nova-compute[82394]:   </features>
Apr 12 00:25:45 user nova-compute[82394]: </domainCapabilities>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82394) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82394) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Checking secure boot support for host arch (x86_64) {{(pid=82394) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 00:25:45 user nova-compute[82394]: INFO nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Secure Boot support detected
Apr 12 00:25:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] cpu compare xml: <cpu match="exact">
Apr 12 00:25:45 user nova-compute[82394]:   <model>Nehalem</model>
Apr 12 00:25:45 user nova-compute[82394]: </cpu>
Apr 12 00:25:45 user nova-compute[82394]:  {{(pid=82394) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 00:25:45 user nova-compute[82394]: INFO nova.virt.node [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Generated node identity d7e79abf-0487-4aad-a897-f0694d34c558
Apr 12 00:25:45 user nova-compute[82394]: INFO nova.virt.node [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Wrote node identity d7e79abf-0487-4aad-a897-f0694d34c558 to /opt/stack/data/nova/compute_id
Apr 12 00:25:45 user nova-compute[82394]: WARNING nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Compute nodes ['d7e79abf-0487-4aad-a897-f0694d34c558'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 00:25:45 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 00:25:46 user nova-compute[82394]: WARNING nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 00:25:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:25:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:25:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Hypervisor/Node resource view: name=user free_ram=10844MB free_disk=27.158248901367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:25:46 user nova-compute[82394]: WARNING nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] No compute node record for user:d7e79abf-0487-4aad-a897-f0694d34c558: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d7e79abf-0487-4aad-a897-f0694d34c558 could not be found.
Apr 12 00:25:46 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Compute node record created for user:user with uuid: d7e79abf-0487-4aad-a897-f0694d34c558
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:25:46 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [req-d15172b2-50e3-4136-a7ed-7e99d829f45e] Created resource provider record via placement API for resource provider with UUID d7e79abf-0487-4aad-a897-f0694d34c558 and name user.
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82394) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 00:25:46 user nova-compute[82394]: INFO nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] kernel doesn't support AMD SEV
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Libvirt baseline CPU <cpu>
Apr 12 00:25:46 user nova-compute[82394]:   <arch>x86_64</arch>
Apr 12 00:25:46 user nova-compute[82394]:   <model>Nehalem</model>
Apr 12 00:25:46 user nova-compute[82394]:   <vendor>Intel</vendor>
Apr 12 00:25:46 user nova-compute[82394]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 00:25:46 user nova-compute[82394]: </cpu>
Apr 12 00:25:46 user nova-compute[82394]:  {{(pid=82394) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Updated inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Updating resource provider d7e79abf-0487-4aad-a897-f0694d34c558 generation from 0 to 1 during operation: update_inventory {{(pid=82394) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 00:25:46 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Updating resource provider d7e79abf-0487-4aad-a897-f0694d34c558 generation from 1 to 2 during operation: update_traits {{(pid=82394) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG nova.service [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Creating RPC server for service compute {{(pid=82394) start /opt/stack/nova/nova/service.py:182}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG nova.service [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Join ServiceGroup membership for this service compute {{(pid=82394) start /opt/stack/nova/nova/service.py:199}}
Apr 12 00:25:47 user nova-compute[82394]: DEBUG nova.servicegroup.drivers.db [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82394) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 00:26:31 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:31 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:26:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:26:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:26:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=27.072040557861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:26:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:27:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:27:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=10201MB free_disk=27.11920928955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:27:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:27:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:28:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:28:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:28:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:28:38 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:28:39 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:28:39 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.894229888916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:28:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:28:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:28:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:28:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:28:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:29:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:40 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:29:41 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:41 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=9421MB free_disk=26.916244506835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:29:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:29:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:29:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:29:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:29:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:29:45 user nova-compute[82394]: INFO nova.compute.claims [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Claim successful on node user
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:29:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:29:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Creating image(s)
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "/opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "/opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG nova.policy [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.part --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG nova.virt.images [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 7ae54858-7fe8-4bde-be8c-1b0f88b691ea was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.part /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.part /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.converted" returned: 0 in 0.226s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.308s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:47 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx96u89y0/privsep.sock']
Apr 12 00:29:47 user sudo[91114]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx96u89y0/privsep.sock
Apr 12 00:29:47 user sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 00:29:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:29:49 user nova-compute[82394]: INFO nova.compute.claims [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Claim successful on node user
Apr 12 00:29:49 user sudo[91114]: pam_unix(sudo:session): session closed for user root
Apr 12 00:29:49 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Spawned new privsep daemon via rootwrap
Apr 12 00:29:49 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 00:29:49 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 00:29:49 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 00:29:49 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91121
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:29:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.164s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk 1073741824" returned: 0 in 0.061s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:29:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Creating image(s)
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.policy [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.196s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:29:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Successfully created port: cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.219s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Cannot resize image /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'migration_context' on Instance uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Ensure instance console log exists: /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk 1073741824" returned: 0 in 0.061s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Cannot resize image /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Ensure instance console log exists: /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:29:51 user nova-compute[82394]: INFO nova.compute.claims [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Claim successful on node user
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:29:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:29:51 user nova-compute[82394]: DEBUG nova.policy [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:29:52 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Creating image(s)
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.120s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk 1073741824" returned: 0 in 0.057s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Successfully created port: e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Successfully updated port: cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquired lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Cannot resize image /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Ensure instance console log exists: /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-changed-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Refreshing instance network info cache due to event network-changed-cc385c2b-9f16-4daf-a929-f3c9e133e5fa. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Acquiring lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updating instance_info_cache with network_info: [{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Releasing lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Instance network_info: |[{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Acquired lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.neutron [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Refreshing network info cache for port cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Start _get_guest_xml network_info=[{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:29:53 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:53 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1121770049',display_name='tempest-ServersNegativeTestJSON-server-1121770049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1121770049',id=1,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-81fabj4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:46Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.objects.instance [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'pci_devices' on Instance uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:29:53 user nova-compute[82394]:   <uuid>ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9</uuid>
Apr 12 00:29:53 user nova-compute[82394]:   <name>instance-00000001</name>
Apr 12 00:29:53 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:29:53 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:29:53 user nova-compute[82394]:   <metadata>
Apr 12 00:29:53 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:29:53 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:name>tempest-ServersNegativeTestJSON-server-1121770049</nova:name>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:29:53</nova:creationTime>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:29:53 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:29:53 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:owner>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:user uuid="920d6d79e38e45fcb5153e712605764f">tempest-ServersNegativeTestJSON-103053763-project-member</nova:user>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:project uuid="6ee31cdc6f4e4c2b9a8ec1e1c5076010">tempest-ServersNegativeTestJSON-103053763</nova:project>
Apr 12 00:29:53 user nova-compute[82394]:       </nova:owner>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:29:53 user nova-compute[82394]:       <nova:ports>
Apr 12 00:29:53 user nova-compute[82394]:         <nova:port uuid="cc385c2b-9f16-4daf-a929-f3c9e133e5fa">
Apr 12 00:29:53 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 00:29:53 user nova-compute[82394]:         </nova:port>
Apr 12 00:29:53 user nova-compute[82394]:       </nova:ports>
Apr 12 00:29:53 user nova-compute[82394]:     </nova:instance>
Apr 12 00:29:53 user nova-compute[82394]:   </metadata>
Apr 12 00:29:53 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:29:53 user nova-compute[82394]:     <system>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="serial">ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9</entry>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="uuid">ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9</entry>
Apr 12 00:29:53 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:29:53 user nova-compute[82394]:     </system>
Apr 12 00:29:53 user nova-compute[82394]:   </sysinfo>
Apr 12 00:29:53 user nova-compute[82394]:   <os>
Apr 12 00:29:53 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:29:53 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:29:53 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:29:53 user nova-compute[82394]:   </os>
Apr 12 00:29:53 user nova-compute[82394]:   <features>
Apr 12 00:29:53 user nova-compute[82394]:     <acpi/>
Apr 12 00:29:53 user nova-compute[82394]:     <apic/>
Apr 12 00:29:53 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:29:53 user nova-compute[82394]:   </features>
Apr 12 00:29:53 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:29:53 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:29:53 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:29:53 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:29:53 user nova-compute[82394]:   </clock>
Apr 12 00:29:53 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:29:53 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:29:53 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:29:53 user nova-compute[82394]:   </cpu>
Apr 12 00:29:53 user nova-compute[82394]:   <devices>
Apr 12 00:29:53 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:29:53 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:29:53 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk"/>
Apr 12 00:29:53 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:29:53 user nova-compute[82394]:     </disk>
Apr 12 00:29:53 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:29:53 user nova-compute[82394]:       <mac address="fa:16:3e:2a:b1:5d"/>
Apr 12 00:29:53 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:29:53 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:29:53 user nova-compute[82394]:       <target dev="tapcc385c2b-9f"/>
Apr 12 00:29:53 user nova-compute[82394]:     </interface>
Apr 12 00:29:53 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:29:53 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/console.log" append="off"/>
Apr 12 00:29:53 user nova-compute[82394]:     </serial>
Apr 12 00:29:53 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:29:53 user nova-compute[82394]:     <video>
Apr 12 00:29:53 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:29:53 user nova-compute[82394]:     </video>
Apr 12 00:29:53 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:29:53 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:29:53 user nova-compute[82394]:     </rng>
Apr 12 00:29:53 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:29:53 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:29:53 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:29:53 user nova-compute[82394]:     </memballoon>
Apr 12 00:29:53 user nova-compute[82394]:   </devices>
Apr 12 00:29:53 user nova-compute[82394]: </domain>
Apr 12 00:29:53 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1121770049',display_name='tempest-ServersNegativeTestJSON-server-1121770049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1121770049',id=1,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-81fabj4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:46Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:29:53 user nova-compute[82394]: DEBUG os_vif [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Created schema index Interface.name {{(pid=82394) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Created schema index Port.name {{(pid=82394) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Created schema index Bridge.name {{(pid=82394) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [POLLOUT] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Successfully created port: 8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:29:54 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpys6ki99z/privsep.sock']
Apr 12 00:29:54 user sudo[91176]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpys6ki99z/privsep.sock
Apr 12 00:29:54 user sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 00:29:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.network.neutron [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updated VIF entry in instance network info cache for port cc385c2b-9f16-4daf-a929-f3c9e133e5fa. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.network.neutron [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updating instance_info_cache with network_info: [{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Releasing lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Successfully updated port: e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-changed-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Refreshing instance network info cache due to event network-changed-e92d06cb-6535-4389-b328-57add5f4f812. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:29:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:55 user sudo[91176]: pam_unix(sudo:session): session closed for user root
Apr 12 00:29:55 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Spawned new privsep daemon via rootwrap
Apr 12 00:29:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 00:29:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 00:29:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 00:29:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91186
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc385c2b-9f, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc385c2b-9f, col_values=(('external_ids', {'iface-id': 'cc385c2b-9f16-4daf-a929-f3c9e133e5fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:b1:5d', 'vm-uuid': 'ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: INFO os_vif [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f')
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] No VIF found with MAC fa:16:3e:2a:b1:5d, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance network_info: |[{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Refreshing network info cache for port e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start _get_guest_xml network_info=[{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:29:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254044738',display_name='tempest-ServerRescueNegativeTestJSON-server-254044738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254044738',id=2,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-0lxmmwfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:50Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=8d895d64-319f-4c67-8c20-ef0d0437a1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:29:56 user nova-compute[82394]:   <uuid>8d895d64-319f-4c67-8c20-ef0d0437a1f0</uuid>
Apr 12 00:29:56 user nova-compute[82394]:   <name>instance-00000002</name>
Apr 12 00:29:56 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:29:56 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:29:56 user nova-compute[82394]:   <metadata>
Apr 12 00:29:56 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:29:56 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-254044738</nova:name>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:29:56</nova:creationTime>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:29:56 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:29:56 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:owner>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:29:56 user nova-compute[82394]:       </nova:owner>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:29:56 user nova-compute[82394]:       <nova:ports>
Apr 12 00:29:56 user nova-compute[82394]:         <nova:port uuid="e92d06cb-6535-4389-b328-57add5f4f812">
Apr 12 00:29:56 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:29:56 user nova-compute[82394]:         </nova:port>
Apr 12 00:29:56 user nova-compute[82394]:       </nova:ports>
Apr 12 00:29:56 user nova-compute[82394]:     </nova:instance>
Apr 12 00:29:56 user nova-compute[82394]:   </metadata>
Apr 12 00:29:56 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:29:56 user nova-compute[82394]:     <system>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="serial">8d895d64-319f-4c67-8c20-ef0d0437a1f0</entry>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="uuid">8d895d64-319f-4c67-8c20-ef0d0437a1f0</entry>
Apr 12 00:29:56 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:29:56 user nova-compute[82394]:     </system>
Apr 12 00:29:56 user nova-compute[82394]:   </sysinfo>
Apr 12 00:29:56 user nova-compute[82394]:   <os>
Apr 12 00:29:56 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:29:56 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:29:56 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:29:56 user nova-compute[82394]:   </os>
Apr 12 00:29:56 user nova-compute[82394]:   <features>
Apr 12 00:29:56 user nova-compute[82394]:     <acpi/>
Apr 12 00:29:56 user nova-compute[82394]:     <apic/>
Apr 12 00:29:56 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:29:56 user nova-compute[82394]:   </features>
Apr 12 00:29:56 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:29:56 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:29:56 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:29:56 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:29:56 user nova-compute[82394]:   </clock>
Apr 12 00:29:56 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:29:56 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:29:56 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:29:56 user nova-compute[82394]:   </cpu>
Apr 12 00:29:56 user nova-compute[82394]:   <devices>
Apr 12 00:29:56 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:29:56 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:29:56 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk"/>
Apr 12 00:29:56 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:29:56 user nova-compute[82394]:     </disk>
Apr 12 00:29:56 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:29:56 user nova-compute[82394]:       <mac address="fa:16:3e:ac:e7:ce"/>
Apr 12 00:29:56 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:29:56 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:29:56 user nova-compute[82394]:       <target dev="tape92d06cb-65"/>
Apr 12 00:29:56 user nova-compute[82394]:     </interface>
Apr 12 00:29:56 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:29:56 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/console.log" append="off"/>
Apr 12 00:29:56 user nova-compute[82394]:     </serial>
Apr 12 00:29:56 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:29:56 user nova-compute[82394]:     <video>
Apr 12 00:29:56 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:29:56 user nova-compute[82394]:     </video>
Apr 12 00:29:56 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:29:56 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:29:56 user nova-compute[82394]:     </rng>
Apr 12 00:29:56 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:29:56 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:29:56 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:29:56 user nova-compute[82394]:     </memballoon>
Apr 12 00:29:56 user nova-compute[82394]:   </devices>
Apr 12 00:29:56 user nova-compute[82394]: </domain>
Apr 12 00:29:56 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254044738',display_name='tempest-ServerRescueNegativeTestJSON-server-254044738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254044738',id=2,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-0lxmmwfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:50Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=8d895d64-319f-4c67-8c20-ef0d0437a1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG os_vif [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape92d06cb-65, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape92d06cb-65, col_values=(('external_ids', {'iface-id': 'e92d06cb-6535-4389-b328-57add5f4f812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:e7:ce', 'vm-uuid': '8d895d64-319f-4c67-8c20-ef0d0437a1f0'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:56 user nova-compute[82394]: INFO os_vif [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65')
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:29:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:ac:e7:ce, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:29:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Successfully updated port: 8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:29:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updated VIF entry in instance network info cache for port e92d06cb-6535-4389-b328-57add5f4f812. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-changed-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Refreshing instance network info cache due to event network-changed-8cb07b1c-aa00-4fcf-983c-4b42566ef948. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:29:58 user nova-compute[82394]: INFO nova.compute.claims [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Claim successful on node user
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:58 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:29:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:29:59 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating image(s)
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.policy [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.125s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk 1073741824" returned: 0 in 0.043s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] No waiting events found dispatching network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:29:59 user nova-compute[82394]: WARNING nova.compute.manager [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received unexpected event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance with vm_state building and task_state spawning.
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Cannot resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'migration_context' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Ensure instance console log exists: /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance network_info: |[{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.network.neutron [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Refreshing network info cache for port 8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start _get_guest_xml network_info=[{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:29:59 user nova-compute[82394]: WARNING nova.compute.manager [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state building and task_state spawning.
Apr 12 00:29:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:29:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609902258',display_name='tempest-ServerRescueNegativeTestJSON-server-1609902258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609902258',id=3,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-1zbegtx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:52Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=0334c8b1-3d0e-4af5-b86f-a6b41a3d6050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:30:00 user nova-compute[82394]:   <uuid>0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</uuid>
Apr 12 00:30:00 user nova-compute[82394]:   <name>instance-00000003</name>
Apr 12 00:30:00 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:30:00 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:30:00 user nova-compute[82394]:   <metadata>
Apr 12 00:30:00 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:30:00 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1609902258</nova:name>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:29:59</nova:creationTime>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:30:00 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:30:00 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:owner>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:30:00 user nova-compute[82394]:       </nova:owner>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:30:00 user nova-compute[82394]:       <nova:ports>
Apr 12 00:30:00 user nova-compute[82394]:         <nova:port uuid="8cb07b1c-aa00-4fcf-983c-4b42566ef948">
Apr 12 00:30:00 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 00:30:00 user nova-compute[82394]:         </nova:port>
Apr 12 00:30:00 user nova-compute[82394]:       </nova:ports>
Apr 12 00:30:00 user nova-compute[82394]:     </nova:instance>
Apr 12 00:30:00 user nova-compute[82394]:   </metadata>
Apr 12 00:30:00 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:30:00 user nova-compute[82394]:     <system>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="serial">0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</entry>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="uuid">0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</entry>
Apr 12 00:30:00 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:30:00 user nova-compute[82394]:     </system>
Apr 12 00:30:00 user nova-compute[82394]:   </sysinfo>
Apr 12 00:30:00 user nova-compute[82394]:   <os>
Apr 12 00:30:00 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:30:00 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:30:00 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:30:00 user nova-compute[82394]:   </os>
Apr 12 00:30:00 user nova-compute[82394]:   <features>
Apr 12 00:30:00 user nova-compute[82394]:     <acpi/>
Apr 12 00:30:00 user nova-compute[82394]:     <apic/>
Apr 12 00:30:00 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:30:00 user nova-compute[82394]:   </features>
Apr 12 00:30:00 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:30:00 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:30:00 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:30:00 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:30:00 user nova-compute[82394]:   </clock>
Apr 12 00:30:00 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:30:00 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:30:00 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:30:00 user nova-compute[82394]:   </cpu>
Apr 12 00:30:00 user nova-compute[82394]:   <devices>
Apr 12 00:30:00 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:30:00 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:30:00 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk"/>
Apr 12 00:30:00 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:30:00 user nova-compute[82394]:     </disk>
Apr 12 00:30:00 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:30:00 user nova-compute[82394]:       <mac address="fa:16:3e:de:53:f8"/>
Apr 12 00:30:00 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:00 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:30:00 user nova-compute[82394]:       <target dev="tap8cb07b1c-aa"/>
Apr 12 00:30:00 user nova-compute[82394]:     </interface>
Apr 12 00:30:00 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:30:00 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/console.log" append="off"/>
Apr 12 00:30:00 user nova-compute[82394]:     </serial>
Apr 12 00:30:00 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:30:00 user nova-compute[82394]:     <video>
Apr 12 00:30:00 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:00 user nova-compute[82394]:     </video>
Apr 12 00:30:00 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:30:00 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:30:00 user nova-compute[82394]:     </rng>
Apr 12 00:30:00 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:30:00 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:30:00 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:30:00 user nova-compute[82394]:     </memballoon>
Apr 12 00:30:00 user nova-compute[82394]:   </devices>
Apr 12 00:30:00 user nova-compute[82394]: </domain>
Apr 12 00:30:00 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609902258',display_name='tempest-ServerRescueNegativeTestJSON-server-1609902258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609902258',id=3,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-1zbegtx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:52Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=0334c8b1-3d0e-4af5-b86f-a6b41a3d6050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG os_vif [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb07b1c-aa, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cb07b1c-aa, col_values=(('external_ids', {'iface-id': '8cb07b1c-aa00-4fcf-983c-4b42566ef948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:53:f8', 'vm-uuid': '0334c8b1-3d0e-4af5-b86f-a6b41a3d6050'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:00 user nova-compute[82394]: INFO os_vif [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa')
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:de:53:f8, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259401.4426525, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Resumed (Lifecycle Event)
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance spawned successfully.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Successfully created port: b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Instance spawned successfully.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259401.457325, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Started (Lifecycle Event)
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Took 11.86 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] No waiting events found dispatching network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:01 user nova-compute[82394]: WARNING nova.compute.manager [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received unexpected event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance with vm_state building and task_state spawning.
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259401.576623, ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] VM Resumed (Lifecycle Event)
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Took 16.11 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Took 12.82 seconds to build instance.
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259401.5770032, ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] VM Started (Lifecycle Event)
Apr 12 00:30:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:02 user nova-compute[82394]: WARNING nova.compute.manager [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state active and task_state None.
Apr 12 00:30:02 user nova-compute[82394]: INFO nova.compute.manager [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Took 17.15 seconds to build instance.
Apr 12 00:30:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.419s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updated VIF entry in instance network info cache for port 8cb07b1c-aa00-4fcf-983c-4b42566ef948. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259404.3689277, 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] VM Resumed (Lifecycle Event)
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance spawned successfully.
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259404.3732486, 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] VM Started (Lifecycle Event)
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Took 12.57 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:04 user nova-compute[82394]: WARNING nova.compute.manager [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state building and task_state spawning.
Apr 12 00:30:04 user nova-compute[82394]: INFO nova.compute.manager [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Took 13.47 seconds to build instance.
Apr 12 00:30:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.610s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Successfully updated port: b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-changed-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Refreshing instance network info cache due to event network-changed-b99b54c2-0b21-42ea-91d0-087aa230da7e. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:06 user nova-compute[82394]: WARNING nova.compute.manager [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state active and task_state None.
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance network_info: |[{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Refreshing network info cache for port b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start _get_guest_xml network_info=[{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:30:07 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:07 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-1087783512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:30:07 user nova-compute[82394]:   <uuid>dbe6d6bc-65a6-469a-89a0-7e4c51620b14</uuid>
Apr 12 00:30:07 user nova-compute[82394]:   <name>instance-00000004</name>
Apr 12 00:30:07 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:30:07 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:30:07 user nova-compute[82394]:   <metadata>
Apr 12 00:30:07 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:30:07 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-1087783512</nova:name>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:30:07</nova:creationTime>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:30:07 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:30:07 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:owner>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:30:07 user nova-compute[82394]:       </nova:owner>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:30:07 user nova-compute[82394]:       <nova:ports>
Apr 12 00:30:07 user nova-compute[82394]:         <nova:port uuid="b99b54c2-0b21-42ea-91d0-087aa230da7e">
Apr 12 00:30:07 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:30:07 user nova-compute[82394]:         </nova:port>
Apr 12 00:30:07 user nova-compute[82394]:       </nova:ports>
Apr 12 00:30:07 user nova-compute[82394]:     </nova:instance>
Apr 12 00:30:07 user nova-compute[82394]:   </metadata>
Apr 12 00:30:07 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:30:07 user nova-compute[82394]:     <system>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="serial">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="uuid">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:30:07 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:30:07 user nova-compute[82394]:     </system>
Apr 12 00:30:07 user nova-compute[82394]:   </sysinfo>
Apr 12 00:30:07 user nova-compute[82394]:   <os>
Apr 12 00:30:07 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:30:07 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:30:07 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:30:07 user nova-compute[82394]:   </os>
Apr 12 00:30:07 user nova-compute[82394]:   <features>
Apr 12 00:30:07 user nova-compute[82394]:     <acpi/>
Apr 12 00:30:07 user nova-compute[82394]:     <apic/>
Apr 12 00:30:07 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:30:07 user nova-compute[82394]:   </features>
Apr 12 00:30:07 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:30:07 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:30:07 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:30:07 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:30:07 user nova-compute[82394]:   </clock>
Apr 12 00:30:07 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:30:07 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:30:07 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:30:07 user nova-compute[82394]:   </cpu>
Apr 12 00:30:07 user nova-compute[82394]:   <devices>
Apr 12 00:30:07 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:30:07 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:30:07 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk"/>
Apr 12 00:30:07 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:30:07 user nova-compute[82394]:     </disk>
Apr 12 00:30:07 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:30:07 user nova-compute[82394]:       <mac address="fa:16:3e:a1:e7:04"/>
Apr 12 00:30:07 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:07 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:30:07 user nova-compute[82394]:       <target dev="tapb99b54c2-0b"/>
Apr 12 00:30:07 user nova-compute[82394]:     </interface>
Apr 12 00:30:07 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:30:07 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log" append="off"/>
Apr 12 00:30:07 user nova-compute[82394]:     </serial>
Apr 12 00:30:07 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:30:07 user nova-compute[82394]:     <video>
Apr 12 00:30:07 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:07 user nova-compute[82394]:     </video>
Apr 12 00:30:07 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:30:07 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:30:07 user nova-compute[82394]:     </rng>
Apr 12 00:30:07 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:30:07 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:30:07 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:30:07 user nova-compute[82394]:     </memballoon>
Apr 12 00:30:07 user nova-compute[82394]:   </devices>
Apr 12 00:30:07 user nova-compute[82394]: </domain>
Apr 12 00:30:07 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-1087783512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG os_vif [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99b54c2-0b, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb99b54c2-0b, col_values=(('external_ids', {'iface-id': 'b99b54c2-0b21-42ea-91d0-087aa230da7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e7:04', 'vm-uuid': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:07 user nova-compute[82394]: INFO os_vif [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:a1:e7:04, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:30:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:09 user nova-compute[82394]: WARNING nova.compute.manager [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state building and task_state spawning.
Apr 12 00:30:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updated VIF entry in instance network info cache for port b99b54c2-0b21-42ea-91d0-087aa230da7e. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:30:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:11 user nova-compute[82394]: WARNING nova.compute.manager [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state building and task_state spawning.
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259412.2766416, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Resumed (Lifecycle Event)
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance spawned successfully.
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259412.286752, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Started (Lifecycle Event)
Apr 12 00:30:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Took 13.49 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:12 user nova-compute[82394]: INFO nova.compute.manager [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Took 14.55 seconds to build instance.
Apr 12 00:30:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.738s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:23 user nova-compute[82394]: INFO nova.compute.claims [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Claim successful on node user
Apr 12 00:30:23 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:24 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:30:24 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Creating image(s)
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "/opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "/opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "/opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG nova.policy [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4edaa34382341fd8f99f9d0921d80b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff88f0df3414610858ecf3d60295c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.231s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.270s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk 1073741824" returned: 0 in 0.080s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.205s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Cannot resize image /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'migration_context' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Ensure instance console log exists: /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Successfully created port: bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:26 user nova-compute[82394]: INFO nova.compute.claims [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Claim successful on node user
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Successfully updated port: bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquired lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-changed-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Refreshing instance network info cache due to event network-changed-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Acquiring lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating instance_info_cache with network_info: [{"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Releasing lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Instance network_info: |[{"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Acquired lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Refreshing network info cache for port bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Start _get_guest_xml network_info=[{"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:30:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-616241968',display_name='tempest-TestVolumeSwap-server-616241968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-616241968',id=5,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqavOG73YHP/jCE8QYd9eB/mTDgD50nbY+MW+ec/fUDNZvJ4gLz94SBNm7woJpGnkkYo5CN6rOisg49f1aZtON5pBAxIRrPclADfCbPyd0Gh0X+A28pjj3Xe6fQGyNlA==',key_name='tempest-keypair-436204141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff88f0df3414610858ecf3d60295c26',ramdisk_id='',reservation_id='r-yy10724y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1224322718',owner_user_name='tempest-TestVolumeSwap-1224322718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4edaa34382341fd8f99f9d0921d80b6',uuid=5be536dd-61f5-4a17-a734-029b25739a47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converting VIF {"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'pci_devices' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:30:27 user nova-compute[82394]:   <uuid>5be536dd-61f5-4a17-a734-029b25739a47</uuid>
Apr 12 00:30:27 user nova-compute[82394]:   <name>instance-00000005</name>
Apr 12 00:30:27 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:30:27 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:30:27 user nova-compute[82394]:   <metadata>
Apr 12 00:30:27 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:30:27 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:name>tempest-TestVolumeSwap-server-616241968</nova:name>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:30:27</nova:creationTime>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:30:27 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:30:27 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:owner>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:user uuid="e4edaa34382341fd8f99f9d0921d80b6">tempest-TestVolumeSwap-1224322718-project-member</nova:user>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:project uuid="bff88f0df3414610858ecf3d60295c26">tempest-TestVolumeSwap-1224322718</nova:project>
Apr 12 00:30:27 user nova-compute[82394]:       </nova:owner>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:30:27 user nova-compute[82394]:       <nova:ports>
Apr 12 00:30:27 user nova-compute[82394]:         <nova:port uuid="bb2a7afd-3e9c-4291-82ff-c443bee5c1f9">
Apr 12 00:30:27 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:30:27 user nova-compute[82394]:         </nova:port>
Apr 12 00:30:27 user nova-compute[82394]:       </nova:ports>
Apr 12 00:30:27 user nova-compute[82394]:     </nova:instance>
Apr 12 00:30:27 user nova-compute[82394]:   </metadata>
Apr 12 00:30:27 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:30:27 user nova-compute[82394]:     <system>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="serial">5be536dd-61f5-4a17-a734-029b25739a47</entry>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="uuid">5be536dd-61f5-4a17-a734-029b25739a47</entry>
Apr 12 00:30:27 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:30:27 user nova-compute[82394]:     </system>
Apr 12 00:30:27 user nova-compute[82394]:   </sysinfo>
Apr 12 00:30:27 user nova-compute[82394]:   <os>
Apr 12 00:30:27 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:30:27 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:30:27 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:30:27 user nova-compute[82394]:   </os>
Apr 12 00:30:27 user nova-compute[82394]:   <features>
Apr 12 00:30:27 user nova-compute[82394]:     <acpi/>
Apr 12 00:30:27 user nova-compute[82394]:     <apic/>
Apr 12 00:30:27 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:30:27 user nova-compute[82394]:   </features>
Apr 12 00:30:27 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:30:27 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:30:27 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:30:27 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:30:27 user nova-compute[82394]:   </clock>
Apr 12 00:30:27 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:30:27 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:30:27 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:30:27 user nova-compute[82394]:   </cpu>
Apr 12 00:30:27 user nova-compute[82394]:   <devices>
Apr 12 00:30:27 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:30:27 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:30:27 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk"/>
Apr 12 00:30:27 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:30:27 user nova-compute[82394]:     </disk>
Apr 12 00:30:27 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:30:27 user nova-compute[82394]:       <mac address="fa:16:3e:bb:9e:ad"/>
Apr 12 00:30:27 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:27 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:30:27 user nova-compute[82394]:       <target dev="tapbb2a7afd-3e"/>
Apr 12 00:30:27 user nova-compute[82394]:     </interface>
Apr 12 00:30:27 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:30:27 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/console.log" append="off"/>
Apr 12 00:30:27 user nova-compute[82394]:     </serial>
Apr 12 00:30:27 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:30:27 user nova-compute[82394]:     <video>
Apr 12 00:30:27 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:27 user nova-compute[82394]:     </video>
Apr 12 00:30:27 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:30:27 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:30:27 user nova-compute[82394]:     </rng>
Apr 12 00:30:27 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:30:27 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:30:27 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:30:27 user nova-compute[82394]:     </memballoon>
Apr 12 00:30:27 user nova-compute[82394]:   </devices>
Apr 12 00:30:27 user nova-compute[82394]: </domain>
Apr 12 00:30:27 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-616241968',display_name='tempest-TestVolumeSwap-server-616241968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-616241968',id=5,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqavOG73YHP/jCE8QYd9eB/mTDgD50nbY+MW+ec/fUDNZvJ4gLz94SBNm7woJpGnkkYo5CN6rOisg49f1aZtON5pBAxIRrPclADfCbPyd0Gh0X+A28pjj3Xe6fQGyNlA==',key_name='tempest-keypair-436204141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff88f0df3414610858ecf3d60295c26',ramdisk_id='',reservation_id='r-yy10724y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1224322718',owner_user_name='tempest-TestVolumeSwap-1224322718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4edaa34382341fd8f99f9d0921d80b6',uuid=5be536dd-61f5-4a17-a734-029b25739a47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converting VIF {"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG os_vif [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb2a7afd-3e, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb2a7afd-3e, col_values=(('external_ids', {'iface-id': 'bb2a7afd-3e9c-4291-82ff-c443bee5c1f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:9e:ad', 'vm-uuid': '5be536dd-61f5-4a17-a734-029b25739a47'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:27 user nova-compute[82394]: INFO os_vif [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e')
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.policy [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31fe897a730b44bb8c8bf9d92938bc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cf7bd87e954fa892ea0da5332a6589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:30:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Creating image(s)
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] No VIF found with MAC fa:16:3e:bb:9e:ad, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:30:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.part --force-share --output=json" returned: 0 in 0.183s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.virt.images [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] a44d3d49-491b-40c9-8c3b-bc3f938db25c was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.part /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.part /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.converted" returned: 0 in 0.258s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.network.neutron [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updated VIF entry in instance network info cache for port bb2a7afd-3e9c-4291-82ff-c443bee5c1f9. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.network.neutron [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating instance_info_cache with network_info: [{"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Releasing lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.044s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:28 user nova-compute[82394]: INFO nova.compute.claims [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Claim successful on node user
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json" returned: 0 in 0.165s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254,backing_fmt=raw /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254,backing_fmt=raw /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk 1073741824" returned: 0 in 0.072s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "f5bfcbfc9d11bf6091238867a0f439ddd1b12254" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Successfully created port: 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Cannot resize image /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'migration_context' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Ensure instance console log exists: /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.861s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] No waiting events found dispatching network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:29 user nova-compute[82394]: WARNING nova.compute.manager [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received unexpected event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance with vm_state building and task_state spawning.
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:30:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Creating image(s)
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:29 user nova-compute[82394]: DEBUG nova.policy [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Successfully updated port: 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.190s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquired lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-changed-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Refreshing instance network info cache due to event network-changed-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Acquiring lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.170s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk 1073741824" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Cannot resize image /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'migration_context' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updating instance_info_cache with network_info: [{"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Ensure instance console log exists: /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Releasing lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Instance network_info: |[{"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Acquired lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.neutron [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Refreshing network info cache for port 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Start _get_guest_xml network_info=[{"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:30:17Z,direct_url=<?>,disk_format='qcow2',id=a44d3d49-491b-40c9-8c3b-bc3f938db25c,min_disk=0,min_ram=0,name='',owner='9f1eb6da379d4d798e328b50b2fbefc4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:30:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'encrypted': False, 'image_id': 'a44d3d49-491b-40c9-8c3b-bc3f938db25c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:30:30 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:30 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:30:17Z,direct_url=<?>,disk_format='qcow2',id=a44d3d49-491b-40c9-8c3b-bc3f938db25c,min_disk=0,min_ram=0,name='',owner='9f1eb6da379d4d798e328b50b2fbefc4',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:30:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1287308895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1287308895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1287308895',id=6,image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWK9ihmxKkdsVErSw7OgZuNUIpL+qTe4ZmI15q/9/+aifoFw87ghSd+P2MBXDve2Z7zrfv9r+02hHhHZyDBer4WWDnGOM/ysnpJg7MD9NC8prdOD/PW1ucWndbOaiUMg==',key_name='tempest-keypair-992126776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88cf7bd87e954fa892ea0da5332a6589',ramdisk_id='',reservation_id='r-i51id330',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-540615201',owner_user_name='tempest-AttachSCSIVolumeTestJSON-540615201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31fe897a730b44bb8c8bf9d92938bc9b',uuid=db3a1291-c686-4e29-8499-8d49dd74a7bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converting VIF {"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'pci_devices' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:30:30 user nova-compute[82394]:   <uuid>db3a1291-c686-4e29-8499-8d49dd74a7bb</uuid>
Apr 12 00:30:30 user nova-compute[82394]:   <name>instance-00000006</name>
Apr 12 00:30:30 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:30:30 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:30:30 user nova-compute[82394]:   <metadata>
Apr 12 00:30:30 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:30:30 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1287308895</nova:name>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:30:30</nova:creationTime>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:30:30 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:30:30 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:owner>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:user uuid="31fe897a730b44bb8c8bf9d92938bc9b">tempest-AttachSCSIVolumeTestJSON-540615201-project-member</nova:user>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:project uuid="88cf7bd87e954fa892ea0da5332a6589">tempest-AttachSCSIVolumeTestJSON-540615201</nova:project>
Apr 12 00:30:30 user nova-compute[82394]:       </nova:owner>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:root type="image" uuid="a44d3d49-491b-40c9-8c3b-bc3f938db25c"/>
Apr 12 00:30:30 user nova-compute[82394]:       <nova:ports>
Apr 12 00:30:30 user nova-compute[82394]:         <nova:port uuid="7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed">
Apr 12 00:30:30 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:30:30 user nova-compute[82394]:         </nova:port>
Apr 12 00:30:30 user nova-compute[82394]:       </nova:ports>
Apr 12 00:30:30 user nova-compute[82394]:     </nova:instance>
Apr 12 00:30:30 user nova-compute[82394]:   </metadata>
Apr 12 00:30:30 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:30:30 user nova-compute[82394]:     <system>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="serial">db3a1291-c686-4e29-8499-8d49dd74a7bb</entry>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="uuid">db3a1291-c686-4e29-8499-8d49dd74a7bb</entry>
Apr 12 00:30:30 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:30:30 user nova-compute[82394]:     </system>
Apr 12 00:30:30 user nova-compute[82394]:   </sysinfo>
Apr 12 00:30:30 user nova-compute[82394]:   <os>
Apr 12 00:30:30 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:30:30 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:30:30 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:30:30 user nova-compute[82394]:   </os>
Apr 12 00:30:30 user nova-compute[82394]:   <features>
Apr 12 00:30:30 user nova-compute[82394]:     <acpi/>
Apr 12 00:30:30 user nova-compute[82394]:     <apic/>
Apr 12 00:30:30 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:30:30 user nova-compute[82394]:   </features>
Apr 12 00:30:30 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:30:30 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:30:30 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:30:30 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:30:30 user nova-compute[82394]:   </clock>
Apr 12 00:30:30 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:30:30 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:30:30 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:30:30 user nova-compute[82394]:   </cpu>
Apr 12 00:30:30 user nova-compute[82394]:   <devices>
Apr 12 00:30:30 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:30:30 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:30:30 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk"/>
Apr 12 00:30:30 user nova-compute[82394]:       <target dev="sda" bus="scsi"/>
Apr 12 00:30:30 user nova-compute[82394]:       <address type="drive" controller="0" unit="0"/>
Apr 12 00:30:30 user nova-compute[82394]:     </disk>
Apr 12 00:30:30 user nova-compute[82394]:     <disk type="file" device="cdrom">
Apr 12 00:30:30 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 00:30:30 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.config"/>
Apr 12 00:30:30 user nova-compute[82394]:       <target dev="sdb" bus="scsi"/>
Apr 12 00:30:30 user nova-compute[82394]:       <address type="drive" controller="0" unit="1"/>
Apr 12 00:30:30 user nova-compute[82394]:     </disk>
Apr 12 00:30:30 user nova-compute[82394]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 00:30:30 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:30:30 user nova-compute[82394]:       <mac address="fa:16:3e:b3:4f:d8"/>
Apr 12 00:30:30 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:30 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:30:30 user nova-compute[82394]:       <target dev="tap7c91ba2b-6c"/>
Apr 12 00:30:30 user nova-compute[82394]:     </interface>
Apr 12 00:30:30 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:30:30 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/console.log" append="off"/>
Apr 12 00:30:30 user nova-compute[82394]:     </serial>
Apr 12 00:30:30 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:30:30 user nova-compute[82394]:     <video>
Apr 12 00:30:30 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:30 user nova-compute[82394]:     </video>
Apr 12 00:30:30 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:30:30 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:30:30 user nova-compute[82394]:     </rng>
Apr 12 00:30:30 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:30:30 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:30:30 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:30:30 user nova-compute[82394]:     </memballoon>
Apr 12 00:30:30 user nova-compute[82394]:   </devices>
Apr 12 00:30:30 user nova-compute[82394]: </domain>
Apr 12 00:30:30 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1287308895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1287308895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1287308895',id=6,image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWK9ihmxKkdsVErSw7OgZuNUIpL+qTe4ZmI15q/9/+aifoFw87ghSd+P2MBXDve2Z7zrfv9r+02hHhHZyDBer4WWDnGOM/ysnpJg7MD9NC8prdOD/PW1ucWndbOaiUMg==',key_name='tempest-keypair-992126776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88cf7bd87e954fa892ea0da5332a6589',ramdisk_id='',reservation_id='r-i51id330',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-540615201',owner_user_name='tempest-AttachSCSIVolumeTestJSON-540615201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31fe897a730b44bb8c8bf9d92938bc9b',uuid=db3a1291-c686-4e29-8499-8d49dd74a7bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converting VIF {"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG os_vif [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c91ba2b-6c, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c91ba2b-6c, col_values=(('external_ids', {'iface-id': '7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:4f:d8', 'vm-uuid': 'db3a1291-c686-4e29-8499-8d49dd74a7bb'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:30 user nova-compute[82394]: INFO os_vif [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c')
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No BDM found with device name sda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No VIF found with MAC fa:16:3e:b3:4f:d8, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:30:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Using config drive
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Creating config drive at /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.config
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpug232zqq {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Successfully created port: 47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpug232zqq" returned: 0 in 0.060s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updated VIF entry in instance network info cache for port 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updating instance_info_cache with network_info: [{"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Releasing lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259431.701402, 5be536dd-61f5-4a17-a734-029b25739a47 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] VM Resumed (Lifecycle Event)
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] No waiting events found dispatching network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:31 user nova-compute[82394]: WARNING nova.compute.manager [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received unexpected event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance with vm_state building and task_state spawning.
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Instance spawned successfully.
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259431.7045276, 5be536dd-61f5-4a17-a734-029b25739a47 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] VM Started (Lifecycle Event)
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:31 user nova-compute[82394]: INFO nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Took 7.60 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:32 user nova-compute[82394]: INFO nova.compute.manager [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Took 8.70 seconds to build instance.
Apr 12 00:30:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.954s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Successfully updated port: 47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-changed-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing instance network info cache due to event network-changed-47b92afd-7a5c-49a0-aea8-abccac5e350c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] No waiting events found dispatching network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:33 user nova-compute[82394]: WARNING nova.compute.manager [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received unexpected event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance with vm_state building and task_state spawning.
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Instance network_info: |[{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing network info cache for port 47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Start _get_guest_xml network_info=[{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:30:33 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:33 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'pci_devices' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:30:33 user nova-compute[82394]:   <uuid>f9dc12da-4db1-4305-93ea-2bd63870c097</uuid>
Apr 12 00:30:33 user nova-compute[82394]:   <name>instance-00000007</name>
Apr 12 00:30:33 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:30:33 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:30:33 user nova-compute[82394]:   <metadata>
Apr 12 00:30:33 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:30:33 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:30:33</nova:creationTime>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:30:33 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:30:33 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:owner>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:30:33 user nova-compute[82394]:       </nova:owner>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:30:33 user nova-compute[82394]:       <nova:ports>
Apr 12 00:30:33 user nova-compute[82394]:         <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:30:33 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:30:33 user nova-compute[82394]:         </nova:port>
Apr 12 00:30:33 user nova-compute[82394]:       </nova:ports>
Apr 12 00:30:33 user nova-compute[82394]:     </nova:instance>
Apr 12 00:30:33 user nova-compute[82394]:   </metadata>
Apr 12 00:30:33 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:30:33 user nova-compute[82394]:     <system>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="serial">f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="uuid">f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:30:33 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:30:33 user nova-compute[82394]:     </system>
Apr 12 00:30:33 user nova-compute[82394]:   </sysinfo>
Apr 12 00:30:33 user nova-compute[82394]:   <os>
Apr 12 00:30:33 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:30:33 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:30:33 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:30:33 user nova-compute[82394]:   </os>
Apr 12 00:30:33 user nova-compute[82394]:   <features>
Apr 12 00:30:33 user nova-compute[82394]:     <acpi/>
Apr 12 00:30:33 user nova-compute[82394]:     <apic/>
Apr 12 00:30:33 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:30:33 user nova-compute[82394]:   </features>
Apr 12 00:30:33 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:30:33 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:30:33 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:30:33 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:30:33 user nova-compute[82394]:   </clock>
Apr 12 00:30:33 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:30:33 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:30:33 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:30:33 user nova-compute[82394]:   </cpu>
Apr 12 00:30:33 user nova-compute[82394]:   <devices>
Apr 12 00:30:33 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:30:33 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:30:33 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk"/>
Apr 12 00:30:33 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:30:33 user nova-compute[82394]:     </disk>
Apr 12 00:30:33 user nova-compute[82394]:     <disk type="file" device="cdrom">
Apr 12 00:30:33 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 00:30:33 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config"/>
Apr 12 00:30:33 user nova-compute[82394]:       <target dev="hda" bus="ide"/>
Apr 12 00:30:33 user nova-compute[82394]:     </disk>
Apr 12 00:30:33 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:30:33 user nova-compute[82394]:       <mac address="fa:16:3e:89:48:de"/>
Apr 12 00:30:33 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:33 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:30:33 user nova-compute[82394]:       <target dev="tap47b92afd-7a"/>
Apr 12 00:30:33 user nova-compute[82394]:     </interface>
Apr 12 00:30:33 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:30:33 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log" append="off"/>
Apr 12 00:30:33 user nova-compute[82394]:     </serial>
Apr 12 00:30:33 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:30:33 user nova-compute[82394]:     <video>
Apr 12 00:30:33 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:30:33 user nova-compute[82394]:     </video>
Apr 12 00:30:33 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:30:33 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:30:33 user nova-compute[82394]:     </rng>
Apr 12 00:30:33 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:30:33 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:30:33 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:30:33 user nova-compute[82394]:     </memballoon>
Apr 12 00:30:33 user nova-compute[82394]:   </devices>
Apr 12 00:30:33 user nova-compute[82394]: </domain>
Apr 12 00:30:33 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG os_vif [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47b92afd-7a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47b92afd-7a, col_values=(('external_ids', {'iface-id': '47b92afd-7a5c-49a0-aea8-abccac5e350c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:48:de', 'vm-uuid': 'f9dc12da-4db1-4305-93ea-2bd63870c097'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: INFO os_vif [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a')
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name hda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No VIF found with MAC fa:16:3e:89:48:de, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:30:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Using config drive
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updated VIF entry in instance network info cache for port 47b92afd-7a5c-49a0-aea8-abccac5e350c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Creating config drive at /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config
Apr 12 00:30:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjgnf6ys {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjgnf6ys" returned: 0 in 0.060s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] No waiting events found dispatching network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:35 user nova-compute[82394]: WARNING nova.compute.manager [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received unexpected event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance with vm_state building and task_state spawning.
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259435.4833102, db3a1291-c686-4e29-8499-8d49dd74a7bb => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] VM Resumed (Lifecycle Event)
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Instance spawned successfully.
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259435.4835107, db3a1291-c686-4e29-8499-8d49dd74a7bb => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] VM Started (Lifecycle Event)
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Took 8.12 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:35 user nova-compute[82394]: INFO nova.compute.manager [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Took 9.41 seconds to build instance.
Apr 12 00:30:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.570s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:37 user nova-compute[82394]: WARNING nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c for instance with vm_state building and task_state spawning.
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:30:37 user nova-compute[82394]: WARNING nova.compute.manager [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c for instance with vm_state building and task_state spawning.
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:30:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259438.5044851, f9dc12da-4db1-4305-93ea-2bd63870c097 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] VM Resumed (Lifecycle Event)
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Instance spawned successfully.
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259438.5050619, f9dc12da-4db1-4305-93ea-2bd63870c097 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] VM Started (Lifecycle Event)
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Took 8.79 seconds to spawn the instance on the hypervisor.
Apr 12 00:30:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:30:38 user nova-compute[82394]: INFO nova.compute.manager [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Took 10.11 seconds to build instance.
Apr 12 00:30:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.239s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:42 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:30:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7895MB free_disk=26.720909118652344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance db3a1291-c686-4e29-8499-8d49dd74a7bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 5be536dd-61f5-4a17-a734-029b25739a47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f9dc12da-4db1-4305-93ea-2bd63870c097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:47 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:30:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.052s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:30:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updating instance_info_cache with network_info: [{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:52 user nova-compute[82394]: INFO nova.compute.claims [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Claim successful on node user
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:53 user nova-compute[82394]: INFO nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Booting with volume b952b7bd-63f1-4f96-be7e-f66be254c652 at /dev/vda
Apr 12 00:30:53 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:30:53 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1qhbldt0/privsep.sock']
Apr 12 00:30:53 user sudo[92354]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1qhbldt0/privsep.sock
Apr 12 00:30:53 user sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 00:30:53 user nova-compute[82394]: DEBUG nova.policy [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:54 user nova-compute[82394]: INFO nova.compute.claims [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Claim successful on node user
Apr 12 00:30:54 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully created port: ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:54 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:55 user nova-compute[82394]: INFO nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Booting with volume b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 at /dev/vda
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:30:55 user sudo[92354]: pam_unix(sudo:session): session closed for user root
Apr 12 00:30:55 user nova-compute[82394]: INFO oslo.privsep.daemon [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Spawned new privsep daemon via rootwrap
Apr 12 00:30:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 00:30:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 00:30:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 00:30:55 user nova-compute[82394]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92359
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a832f0f-8086-4bbe-90c9-3b7d0086697a]: (2,) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: WARNING oslo_privsep.priv_context [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] privsep daemon already running
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.policy [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6beecb5-0433-4a97-a119-439021b8e2c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: WARNING os_brick.initiator.connectors.nvmeof [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac75009-925a-4fa2-bb54-7b52f250e4d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8af8a7-a2d3-4046-807f-22f91584bcde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dae663-8883-4b35-bf93-7fc58e3bb6da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff0ccae-a8c8-406b-827e-416befc12122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cdc65-6fca-4663-a076-1e457b62fe8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa915c7-5c1f-4007-9f22-5e699ad5c2d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08b2b2-5afe-4e33-81d4-e7d8a8372444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:30:55 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d4021-c7f7-4699-8cc0-72cc3ae980c5]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== get_connector_properties: return (2206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating existing volume attachment record: d808c922-314d-45a8-82e7-cd652166515e {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:30:55 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:30:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a853ea-3492-4ddc-af08-86d7b1389885]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== get_connector_properties: return (438ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:30:55 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating existing volume attachment record: 9130096d-4645-4908-ba47-1fba4e7813c2 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:30:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully created port: b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully created port: 09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully created port: b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully created port: bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:30:58 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:30:58 user nova-compute[82394]: INFO nova.compute.claims [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Claim successful on node user
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:30:59 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:30:59 user nova-compute[82394]: INFO nova.virt.block_device [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Booting with volume snapshot 1addebe1-54e0-40c1-ba5e-42b125ecbe37 at /dev/vda
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.policy [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:30:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully created port: 34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Successfully created port: b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully created port: f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:00 user nova-compute[82394]: INFO nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Booting with volume c85736f3-0744-49a3-a4b9-c65987e67df4 at /dev/vdb
Apr 12 00:31:00 user nova-compute[82394]: INFO nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Booting with volume 68781ad8-f1c7-4aa8-8698-e079ecdea5a4 at /dev/vdb
Apr 12 00:31:00 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2e7bf-a5c9-4e65-8c64-44ff48ebabc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ae1f1-ad02-44e9-948d-b2c8833d28d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a813b-b719-4652-9bdf-075c4f710218]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f3e58-d0ab-4110-b2c2-03481d7c21ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbabc116-98b9-4b3e-bfc8-df81ac270a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Successfully updated port: b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d64c0-0ad4-4772-bf3a-61350e1d82f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:01 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdda9df-a943-456e-9ef4-0900c48824b7]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating existing volume attachment record: a88ffad0-b2e4-4182-857f-ecb16c89d6c6 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a572897-6963-4436-b307-f8ddc5caf1ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-changed-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Refreshing instance network info cache due to event network-changed-b987249f-523f-4356-bdc9-82518d86209b. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Acquiring lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa197b33-35de-4831-8a95-75dcbbf8b57d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:01 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77b8c1d-59b7-4a33-be12-68b62ca2a498]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating existing volume attachment record: fbfa2150-b2bf-4622-917c-fbad936d9254 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully created port: 4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Updating instance_info_cache with network_info: [{"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Instance network_info: |[{"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Acquired lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Refreshing network info cache for port b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Updated VIF entry in instance network info cache for port b987249f-523f-4356-bdc9-82518d86209b. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Updating instance_info_cache with network_info: [{"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Releasing lock "refresh_cache-7f1f85bf-03e5-493e-b187-955998b020ee" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-ad31f866-7d58-49a8-9e24-17ec4ad04a48. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:03 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully created port: f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: 02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:31:04 user nova-compute[82394]: INFO nova.compute.claims [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Claim successful on node user
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-02d77b15-fb16-44e3-9c20-d319e7302449. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:04 user nova-compute[82394]: DEBUG nova.network.neutron [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port 02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully created port: 9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80225689-c3d2-43d4-87de-d180fdc32462]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d4b67-c0b1-402a-803f-e32e091a111a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb073ff-4dbb-4b09-a7ea-c45d394b5aff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[00159082-19b1-46a3-a3f3-6f8c025bd5f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: 6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:05 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad81cb3-b602-4960-8b7e-e9346ead5ca4]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Updating existing volume attachment record: 198a06a6-5eff-4650-9c05-0cff613d2a72 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.policy [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Creating image(s)
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "/opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "/opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "/opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.176s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:05 user nova-compute[82394]: INFO nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Booting with volume 7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 at /dev/vdc
Apr 12 00:31:05 user nova-compute[82394]: INFO nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Booting with volume 07d78963-38c7-4866-9bf0-26eafb026b18 at /dev/vdc
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab19794b-8b14-41b1-9c38-84ff648bd4a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9787f8-19fb-40b1-bff9-764d3bbc022b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk 1073741824" returned: 0 in 0.058s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1ed0d0-39e4-4e72-93a5-14edf7099d7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a679ab5-8e61-43db-92ec-79df9455e00f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bfb8a2-57b3-4a8e-ad5a-f002f62a76d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2ffcb5-c5d6-4fa9-b17f-dcfcb385eb7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39393e6b-ec43-4f05-9bec-16ada3b9766f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920e5ba-f289-4e99-b2eb-e76c2876ad31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:06 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8374362-0433-4fb5-9250-3a71ffb1bb56]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating existing volume attachment record: 9080ecea-7665-4d75-8230-7c859e246ecc {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:06 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[29571f25-bef3-42ad-841b-9a3f1d7b418f]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== get_connector_properties: return (290ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating existing volume attachment record: cddb7e06-fedd-44cd-a7d9-9c3511a24844 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Cannot resize image /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.objects.instance [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'migration_context' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Ensure instance console log exists: /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: 09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-09b82fec-ca71-4934-ac24-073ca9080c9c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.network.neutron [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port 09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Successfully created port: 7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:06 user nova-compute[82394]: DEBUG nova.network.neutron [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-6903c204-8c47-4dbf-991d-28e91739df40. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port 6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Successfully updated port: 7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquired lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing instance network info cache due to event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Acquiring lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating instance_info_cache with network_info: [{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Releasing lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Instance network_info: |[{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Acquired lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Start _get_guest_xml network_info=[{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:08 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:08 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196189311',display_name='tempest-TestStampPattern-server-1196189311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196189311',id=11,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-5hnlks40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:06Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=d25bc2e7-3399-47be-b78d-990acbb51749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.objects.instance [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'pci_devices' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:08 user nova-compute[82394]:   <uuid>d25bc2e7-3399-47be-b78d-990acbb51749</uuid>
Apr 12 00:31:08 user nova-compute[82394]:   <name>instance-0000000b</name>
Apr 12 00:31:08 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:08 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:08 user nova-compute[82394]:   <metadata>
Apr 12 00:31:08 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:08 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:name>tempest-TestStampPattern-server-1196189311</nova:name>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:08</nova:creationTime>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:08 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:08 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:user uuid="0e843a45549943cb88b1b3123a2fbe8a">tempest-TestStampPattern-628358733-project-member</nova:user>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:project uuid="ca0ea21a2d4d400cba79444c68b58aed">tempest-TestStampPattern-628358733</nova:project>
Apr 12 00:31:08 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:08 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:08 user nova-compute[82394]:         <nova:port uuid="7f434880-804b-43da-b1ab-5d5e05b5bee1">
Apr 12 00:31:08 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:31:08 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:08 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:08 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:08 user nova-compute[82394]:   </metadata>
Apr 12 00:31:08 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:08 user nova-compute[82394]:     <system>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="serial">d25bc2e7-3399-47be-b78d-990acbb51749</entry>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="uuid">d25bc2e7-3399-47be-b78d-990acbb51749</entry>
Apr 12 00:31:08 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:08 user nova-compute[82394]:     </system>
Apr 12 00:31:08 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:08 user nova-compute[82394]:   <os>
Apr 12 00:31:08 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:08 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:08 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:08 user nova-compute[82394]:   </os>
Apr 12 00:31:08 user nova-compute[82394]:   <features>
Apr 12 00:31:08 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:08 user nova-compute[82394]:     <apic/>
Apr 12 00:31:08 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:08 user nova-compute[82394]:   </features>
Apr 12 00:31:08 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:08 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:08 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:08 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:08 user nova-compute[82394]:   </clock>
Apr 12 00:31:08 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:08 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:08 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:08 user nova-compute[82394]:   </cpu>
Apr 12 00:31:08 user nova-compute[82394]:   <devices>
Apr 12 00:31:08 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:31:08 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:31:08 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk"/>
Apr 12 00:31:08 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:08 user nova-compute[82394]:     </disk>
Apr 12 00:31:08 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:08 user nova-compute[82394]:       <mac address="fa:16:3e:15:62:29"/>
Apr 12 00:31:08 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:08 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:08 user nova-compute[82394]:       <target dev="tap7f434880-80"/>
Apr 12 00:31:08 user nova-compute[82394]:     </interface>
Apr 12 00:31:08 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:08 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/console.log" append="off"/>
Apr 12 00:31:08 user nova-compute[82394]:     </serial>
Apr 12 00:31:08 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:08 user nova-compute[82394]:     <video>
Apr 12 00:31:08 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:08 user nova-compute[82394]:     </video>
Apr 12 00:31:08 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:08 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:08 user nova-compute[82394]:     </rng>
Apr 12 00:31:08 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:08 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:08 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:08 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:08 user nova-compute[82394]:   </devices>
Apr 12 00:31:08 user nova-compute[82394]: </domain>
Apr 12 00:31:08 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196189311',display_name='tempest-TestStampPattern-server-1196189311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196189311',id=11,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-5hnlks40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:06Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=d25bc2e7-3399-47be-b78d-990acbb51749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG os_vif [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f434880-80, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f434880-80, col_values=(('external_ids', {'iface-id': '7f434880-804b-43da-b1ab-5d5e05b5bee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:62:29', 'vm-uuid': 'd25bc2e7-3399-47be-b78d-990acbb51749'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:08 user nova-compute[82394]: INFO os_vif [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80')
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No VIF found with MAC fa:16:3e:15:62:29, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: 0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-0b6ea381-2a40-4f39-a8a5-88a31565ea17. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port 0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.network.neutron [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-b9c15342-4557-47ce-a9ed-4c378fe66186. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.network.neutron [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updated VIF entry in instance network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.network.neutron [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating instance_info_cache with network_info: [{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Releasing lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:09 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: 8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:10 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Creating image(s)
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Ensure instance console log exists: /opt/stack/data/nova/instances/7f1f85bf-03e5-493e-b187-955998b020ee/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Start _get_guest_xml network_info=[{"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '198a06a6-5eff-4650-9c05-0cff613d2a72', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyvIYkhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f1f85bf-03e5-493e-b187-955998b020ee', 'attached_at': '', 'detached_at': '', 'volume_id': '7f8f8733-e863-4c36-bdd5-bdc33446a551', 'serial': '7f8f8733-e863-4c36-bdd5-bdc33446a551'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connector [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Factory for ISCSI on None {{(pid=82394) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.022s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyvIYkhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:10 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d83f6-978b-460b-a717-ada566d5e47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.073s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff827fb9-23ac-4d68-a70c-17cf54457c69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551] added
Apr 12 00:31:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[12706cd9-bba5-4f66-b073-5ea0ff854635]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db5dfd-6d68-4cc2-a0de-eb6a221774d1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyvIYkhc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyvIYkhc" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebffd0-22a4-4337-b3da-6434a1a36828]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AyvIYkhc'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f636e21-bbad-4f33-a35e-d09fe95cb327]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ae118a-8341-46fe-bd1f-8a3e3fe02ff1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:31:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:31:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 00:31:10 user nova-compute[82394]: 
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] No waiting events found dispatching network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:10 user nova-compute[82394]: WARNING nova.compute.manager [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received unexpected event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance with vm_state building and task_state spawning.
Apr 12 00:31:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d052e1d-dba2-4946-94c2-177bf36f7759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260]
Apr 12 00:31:11 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Creating image(s)
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Ensure instance console log exists: /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c753b5-b087-4deb-86d4-b6cb92ab82cc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692ef92-d9a6-43f8-9c90-9f0978e8b5f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b5f0c-8ca2-421f-9e6e-aa6b4d29b768]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyvIYkhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Creating image(s)
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Ensure instance console log exists: /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-8d5703b7-ffc6-4337-9cbe-98328e04c0eb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port 8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: 34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-34faa1f7-7c0e-4272-a3b6-092979dd46b8. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port 34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26462396230356662', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462396230356662', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839730056',display_name='tempest-TestVolumeBootPattern-server-839730056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839730056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-jltfkn3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:00Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=7f1f85bf-03e5-493e-b187-955998b020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f1f85bf-03e5-493e-b187-955998b020ee {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:12 user nova-compute[82394]:   <uuid>7f1f85bf-03e5-493e-b187-955998b020ee</uuid>
Apr 12 00:31:12 user nova-compute[82394]:   <name>instance-0000000a</name>
Apr 12 00:31:12 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:12 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:12 user nova-compute[82394]:   <metadata>
Apr 12 00:31:12 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:12 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:12 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-server-839730056</nova:name>
Apr 12 00:31:12 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:10</nova:creationTime>
Apr 12 00:31:12 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:12 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:12 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:12 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:31:12 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:12 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:12 user nova-compute[82394]:         <nova:port uuid="b987249f-523f-4356-bdc9-82518d86209b">
Apr 12 00:31:12 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:31:12 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:12 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:12 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:12 user nova-compute[82394]:   </metadata>
Apr 12 00:31:12 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:12 user nova-compute[82394]:     <system>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="serial">7f1f85bf-03e5-493e-b187-955998b020ee</entry>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="uuid">7f1f85bf-03e5-493e-b187-955998b020ee</entry>
Apr 12 00:31:12 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:12 user nova-compute[82394]:     </system>
Apr 12 00:31:12 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:12 user nova-compute[82394]:   <os>
Apr 12 00:31:12 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:12 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:12 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:12 user nova-compute[82394]:   </os>
Apr 12 00:31:12 user nova-compute[82394]:   <features>
Apr 12 00:31:12 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:12 user nova-compute[82394]:     <apic/>
Apr 12 00:31:12 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:12 user nova-compute[82394]:   </features>
Apr 12 00:31:12 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:12 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:12 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:12 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:12 user nova-compute[82394]:   </clock>
Apr 12 00:31:12 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:12 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:12 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:12 user nova-compute[82394]:   </cpu>
Apr 12 00:31:12 user nova-compute[82394]:   <devices>
Apr 12 00:31:12 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:12 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:12 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:31:12 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:12 user nova-compute[82394]:       <serial>7f8f8733-e863-4c36-bdd5-bdc33446a551</serial>
Apr 12 00:31:12 user nova-compute[82394]:     </disk>
Apr 12 00:31:12 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:12 user nova-compute[82394]:       <mac address="fa:16:3e:c2:2b:c3"/>
Apr 12 00:31:12 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:12 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:12 user nova-compute[82394]:       <target dev="tapb987249f-52"/>
Apr 12 00:31:12 user nova-compute[82394]:     </interface>
Apr 12 00:31:12 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:12 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/7f1f85bf-03e5-493e-b187-955998b020ee/console.log" append="off"/>
Apr 12 00:31:12 user nova-compute[82394]:     </serial>
Apr 12 00:31:12 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:12 user nova-compute[82394]:     <video>
Apr 12 00:31:12 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:12 user nova-compute[82394]:     </video>
Apr 12 00:31:12 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:12 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:12 user nova-compute[82394]:     </rng>
Apr 12 00:31:12 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:12 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:12 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:12 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:12 user nova-compute[82394]:   </devices>
Apr 12 00:31:12 user nova-compute[82394]: </domain>
Apr 12 00:31:12 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839730056',display_name='tempest-TestVolumeBootPattern-server-839730056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839730056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-jltfkn3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:00Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=7f1f85bf-03e5-493e-b187-955998b020ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG os_vif [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb987249f-52, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb987249f-52, col_values=(('external_ids', {'iface-id': 'b987249f-523f-4356-bdc9-82518d86209b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:2b:c3', 'vm-uuid': '7f1f85bf-03e5-493e-b187-955998b020ee'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:12 user nova-compute[82394]: INFO os_vif [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52')
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:c2:2b:c3, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259472.8388727, d25bc2e7-3399-47be-b78d-990acbb51749 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] VM Resumed (Lifecycle Event)
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Instance spawned successfully.
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259472.839307, d25bc2e7-3399-47be-b78d-990acbb51749 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] VM Started (Lifecycle Event)
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:12 user nova-compute[82394]: INFO nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Took 7.27 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:13 user nova-compute[82394]: INFO nova.compute.manager [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Took 8.43 seconds to build instance.
Apr 12 00:31:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.531s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] No waiting events found dispatching network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:13 user nova-compute[82394]: WARNING nova.compute.manager [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received unexpected event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance with vm_state active and task_state None.
Apr 12 00:31:13 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] No waiting events found dispatching network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:14 user nova-compute[82394]: WARNING nova.compute.manager [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received unexpected event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b for instance with vm_state building and task_state spawning.
Apr 12 00:31:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Successfully updated port: 4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259476.0096326, 7f1f85bf-03e5-493e-b187-955998b020ee => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] VM Resumed (Lifecycle Event)
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Instance spawned successfully.
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259476.011412, 7f1f85bf-03e5-493e-b187-955998b020ee => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] VM Started (Lifecycle Event)
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Took 5.71 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:16 user nova-compute[82394]: INFO nova.compute.manager [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Took 17.45 seconds to build instance.
Apr 12 00:31:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.551s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-bb8ab354-dbbc-4141-9499-5689ae95fb2f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-f528d725-8cc8-49c2-8e45-56340893e4c7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:31:19 user nova-compute[82394]: INFO nova.compute.claims [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Claim successful on node user
Apr 12 00:31:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:19 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:31:20 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:20 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Creating image(s)
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "/opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "/opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Successfully updated port: 9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.policy [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5219586e4e24c33a8cdf52c21d875bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12eca8b17b844a8821294ec9dd19de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.185s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk 1073741824" returned: 0 in 0.072s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance network_info: |[{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port 4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Start _get_guest_xml network_info=[{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd808c922-314d-45a8-82e7-cd652166515e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcgLFWam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3b52368-86be-4211-a37b-522ed3991a00', 'attached_at': '', 'detached_at': '', 'volume_id': 'b952b7bd-63f1-4f96-be7e-f66be254c652', 'serial': 'b952b7bd-63f1-4f96-be7e-f66be254c652'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': 'fbfa2150-b2bf-4622-917c-fbad936d9254', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upVNxArC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3b52368-86be-4211-a37b-522ed3991a00', 'attached_at': '', 'detached_at': '', 'volume_id': '68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 'serial': '68781ad8-f1c7-4aa8-8698-e079ecdea5a4'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': '9080ecea-7665-4d75-8230-7c859e246ecc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmVUIaSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3b52368-86be-4211-a37b-522ed3991a00', 'attached_at': '', 'detached_at': '', 'volume_id': '07d78963-38c7-4866-9bf0-26eafb026b18', 'serial': '07d78963-38c7-4866-9bf0-26eafb026b18'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:20 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:20 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcgLFWam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:20 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:20 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:20 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.172s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:31:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[908269c1-b907-47d3-87fe-0c25081a246e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:21 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b31430-bae8-497f-a6b7-2b03cecdc479]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652] added
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d439fb2-eaef-48c8-8f8d-25e174b26b4c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[477265cf-a900-44b8-a9e8-2f9f37b681a2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcgLFWam {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Cannot resize image /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'migration_context' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcgLFWam" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129d485-f158-4411-bade-5d7e24ac99cf]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcgLFWam'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Ensure instance console log exists: /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[561cfca3-7df2-4d82-aae9-22d0980320f8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aea3d56-53fd-4d60-b773-8fbe2f3e3aab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff2374-ebb8-42d5-b72c-591407d7d6bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260]
Apr 12 00:31:21 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d18f7a-b96d-48a2-9972-a4b162b74898]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9dc2b-7967-4b1c-aff4-1d1cdf4367a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa3255-dbff-405b-a3b2-948c0bb2a437]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcgLFWam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updated VIF entry in instance network info cache for port 4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] No waiting events found dispatching network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:22 user nova-compute[82394]: WARNING nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received unexpected event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b for instance with vm_state active and task_state None.
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-f9be977e-033f-44cb-adda-1590a13ccbdb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23733613163336166', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613163336166', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upVNxArC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:22 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:22 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:22 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abcee1-c285-462f-91b6-6a74fe995909]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:22 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b18d28-4ce0-4f4d-9b9d-bd2b56dd37b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4] added
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61fa4f4-f370-4b13-b2b9-416e5d5b3100]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3933504-8dab-4c22-a181-09cb46c3c99e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upVNxArC {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upVNxArC" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[18131649-3d43-431e-9100-97c94b366c25]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upVNxArC'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Successfully created port: 71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e4861-fcbf-41f2-b807-77526eb3f079]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5bc98b-77b5-497d-b6d4-b9149ede494c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48057d6-9d04-4d9b-adc1-aabc635b0394]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260]
Apr 12 00:31:22 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34fc9e1-9e19-4157-91c5-6db8b7f49d21]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2daf96d-870b-42d0-b5c0-3408d81f2f70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.042s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d7efd6-ec48-4da3-8f46-db1113f410fb]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upVNxArC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23262653535633761', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262653535633761', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmVUIaSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:24 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:24 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:24 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f13de1-7aef-4ecf-bcaf-eebf0ff454be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:24 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d29651-3e9a-49ba-8126-c3dc696cb2c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18] added
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.080s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f74e8-a37e-4600-8655-78c07d8fc1d5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b051a8-c2b6-43a1-98f1-eae214c24e9a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmVUIaSL {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmVUIaSL" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7503ea-6f74-4a07-9183-27f4d4287d4b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmVUIaSL'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85f74f9-fbb4-461e-9623-b596bc81f22b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af84df10-be83-431b-a478-c69b4985c594]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cecb10d-edbf-4477-a344-68e13adde2d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260]
Apr 12 00:31:24 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a44d570-c01c-474e-9796-c780da0dda3a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff948c-0f2b-44f9-a708-a786ed0f108d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.575s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e67ef0-80b5-462d-b599-c087b9bd4adb]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Successfully updated port: 71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquired lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing instance network info cache due to event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Acquiring lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmVUIaSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.622s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== connect_volume: return (1624ms) {'type': 'block', 'scsi_wwn': '26639653037363061', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639653037363061', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lazy-loading 'pci_devices' on Instance uuid e3b52368-86be-4211-a37b-522ed3991a00 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:25 user nova-compute[82394]:   <uuid>e3b52368-86be-4211-a37b-522ed3991a00</uuid>
Apr 12 00:31:25 user nova-compute[82394]:   <name>instance-00000008</name>
Apr 12 00:31:25 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:25 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:25 user nova-compute[82394]:   <metadata>
Apr 12 00:31:25 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:25 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:name>tempest-device-tagging-server-1572227016</nova:name>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:20</nova:creationTime>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:25 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:25 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:user uuid="846fa2a73bbb4036ad3fb19afc811131">tempest-TaggedBootDevicesTest_v242-2057856153-project-member</nova:user>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:project uuid="c45d99a301794a748dadf4c96860835c">tempest-TaggedBootDevicesTest_v242-2057856153</nova:project>
Apr 12 00:31:25 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:25 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="ad31f866-7d58-49a8-9e24-17ec4ad04a48">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="02d77b15-fb16-44e3-9c20-d319e7302449">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.94" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="6903c204-8c47-4dbf-991d-28e91739df40">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="b9c15342-4557-47ce-a9ed-4c378fe66186">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="b09d545e-e05d-42e0-b1d4-46fe7d8a6e46">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="34faa1f7-7c0e-4272-a3b6-092979dd46b8">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:         <nova:port uuid="4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6">
Apr 12 00:31:25 user nova-compute[82394]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 00:31:25 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:25 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:25 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:25 user nova-compute[82394]:   </metadata>
Apr 12 00:31:25 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:25 user nova-compute[82394]:     <system>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="serial">e3b52368-86be-4211-a37b-522ed3991a00</entry>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="uuid">e3b52368-86be-4211-a37b-522ed3991a00</entry>
Apr 12 00:31:25 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:25 user nova-compute[82394]:     </system>
Apr 12 00:31:25 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:25 user nova-compute[82394]:   <os>
Apr 12 00:31:25 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:25 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:25 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:25 user nova-compute[82394]:   </os>
Apr 12 00:31:25 user nova-compute[82394]:   <features>
Apr 12 00:31:25 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:25 user nova-compute[82394]:     <apic/>
Apr 12 00:31:25 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:25 user nova-compute[82394]:   </features>
Apr 12 00:31:25 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:25 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:25 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:25 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:25 user nova-compute[82394]:   </clock>
Apr 12 00:31:25 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:25 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:25 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:25 user nova-compute[82394]:   </cpu>
Apr 12 00:31:25 user nova-compute[82394]:   <devices>
Apr 12 00:31:25 user nova-compute[82394]:     <disk type="file" device="cdrom">
Apr 12 00:31:25 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 00:31:25 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/disk.config"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="hda" bus="ide"/>
Apr 12 00:31:25 user nova-compute[82394]:     </disk>
Apr 12 00:31:25 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:25 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:25 user nova-compute[82394]:       <source dev="/dev/sdc"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <serial>b952b7bd-63f1-4f96-be7e-f66be254c652</serial>
Apr 12 00:31:25 user nova-compute[82394]:     </disk>
Apr 12 00:31:25 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:25 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:25 user nova-compute[82394]:       <source dev="/dev/sdd"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <serial>68781ad8-f1c7-4aa8-8698-e079ecdea5a4</serial>
Apr 12 00:31:25 user nova-compute[82394]:     </disk>
Apr 12 00:31:25 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:25 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:25 user nova-compute[82394]:       <source dev="/dev/sde"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="vdc" bus="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <serial>07d78963-38c7-4866-9bf0-26eafb026b18</serial>
Apr 12 00:31:25 user nova-compute[82394]:     </disk>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:a8:a1:62"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tapad31f866-7d"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:d3:ad:4c"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tap02d77b15-fb"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:19:58:44"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tap6903c204-8c"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:4a:c7:40"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tapb9c15342-45"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:b7:7e:c2"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tapb09d545e-e0"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:03:bd:d4"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tap34faa1f7-7c"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:25 user nova-compute[82394]:       <mac address="fa:16:3e:fc:b6:ff"/>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:25 user nova-compute[82394]:       <target dev="tap4a80b7d7-aa"/>
Apr 12 00:31:25 user nova-compute[82394]:     </interface>
Apr 12 00:31:25 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:25 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/console.log" append="off"/>
Apr 12 00:31:25 user nova-compute[82394]:     </serial>
Apr 12 00:31:25 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:25 user nova-compute[82394]:     <video>
Apr 12 00:31:25 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:25 user nova-compute[82394]:     </video>
Apr 12 00:31:25 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:25 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:25 user nova-compute[82394]:     </rng>
Apr 12 00:31:25 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:25 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:25 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:25 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:25 user nova-compute[82394]:   </devices>
Apr 12 00:31:25 user nova-compute[82394]: </domain>
Apr 12 00:31:25 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad31f866-7d, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad31f866-7d, col_values=(('external_ids', {'iface-id': 'ad31f866-7d58-49a8-9e24-17ec4ad04a48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:a1:62', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d')
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02d77b15-fb, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02d77b15-fb, col_values=(('external_ids', {'iface-id': '02d77b15-fb16-44e3-9c20-d319e7302449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ad:4c', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb')
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6903c204-8c, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6903c204-8c, col_values=(('external_ids', {'iface-id': '6903c204-8c47-4dbf-991d-28e91739df40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:58:44', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9c15342-45, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9c15342-45, col_values=(('external_ids', {'iface-id': 'b9c15342-4557-47ce-a9ed-4c378fe66186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:c7:40', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating instance_info_cache with network_info: [{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Releasing lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Instance network_info: |[{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Acquired lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.neutron [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Start _get_guest_xml network_info=[{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb09d545e-e0, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb09d545e-e0, col_values=(('external_ids', {'iface-id': 'b09d545e-e05d-42e0-b1d4-46fe7d8a6e46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:7e:c2', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234273224',display_name='tempest-SnapshotDataIntegrityTests-server-234273224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234273224',id=12,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP1c5/DXHZ03s6Jdn9okYMn378SHeUgFUdyzdwxHtCPGziXx0bIkFiht3GzYK2UQV1ksfRO+sxkDOUgz1Da1rC/+VwIe2/nk+J4nKbMkEnpWPIkQxI6eGb5x1NRAtYWkw==',key_name='tempest-SnapshotDataIntegrityTests-1604911239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12eca8b17b844a8821294ec9dd19de8',ramdisk_id='',reservation_id='r-50ifr5ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-282769033',owner_user_name='tempest-SnapshotDataIntegrityTests-282769033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:20Z,user_data=None,user_id='c5219586e4e24c33a8cdf52c21d875bd',uuid=9d67708d-1bcf-4d32-8d45-22376ec72e34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converting VIF {"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:26 user nova-compute[82394]:   <uuid>9d67708d-1bcf-4d32-8d45-22376ec72e34</uuid>
Apr 12 00:31:26 user nova-compute[82394]:   <name>instance-0000000c</name>
Apr 12 00:31:26 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:26 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:26 user nova-compute[82394]:   <metadata>
Apr 12 00:31:26 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:26 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-234273224</nova:name>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:26</nova:creationTime>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:26 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:26 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:user uuid="c5219586e4e24c33a8cdf52c21d875bd">tempest-SnapshotDataIntegrityTests-282769033-project-member</nova:user>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:project uuid="e12eca8b17b844a8821294ec9dd19de8">tempest-SnapshotDataIntegrityTests-282769033</nova:project>
Apr 12 00:31:26 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:26 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:26 user nova-compute[82394]:         <nova:port uuid="71a3bef9-13f4-4aab-ba85-a26faa225efb">
Apr 12 00:31:26 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:31:26 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:26 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:26 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:26 user nova-compute[82394]:   </metadata>
Apr 12 00:31:26 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:26 user nova-compute[82394]:     <system>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="serial">9d67708d-1bcf-4d32-8d45-22376ec72e34</entry>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="uuid">9d67708d-1bcf-4d32-8d45-22376ec72e34</entry>
Apr 12 00:31:26 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:26 user nova-compute[82394]:     </system>
Apr 12 00:31:26 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:26 user nova-compute[82394]:   <os>
Apr 12 00:31:26 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:26 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:26 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:26 user nova-compute[82394]:   </os>
Apr 12 00:31:26 user nova-compute[82394]:   <features>
Apr 12 00:31:26 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:26 user nova-compute[82394]:     <apic/>
Apr 12 00:31:26 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:26 user nova-compute[82394]:   </features>
Apr 12 00:31:26 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:26 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:26 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:26 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:26 user nova-compute[82394]:   </clock>
Apr 12 00:31:26 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:26 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:26 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:26 user nova-compute[82394]:   </cpu>
Apr 12 00:31:26 user nova-compute[82394]:   <devices>
Apr 12 00:31:26 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:31:26 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:31:26 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk"/>
Apr 12 00:31:26 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:26 user nova-compute[82394]:     </disk>
Apr 12 00:31:26 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:26 user nova-compute[82394]:       <mac address="fa:16:3e:ad:aa:95"/>
Apr 12 00:31:26 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:26 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:26 user nova-compute[82394]:       <target dev="tap71a3bef9-13"/>
Apr 12 00:31:26 user nova-compute[82394]:     </interface>
Apr 12 00:31:26 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:26 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/console.log" append="off"/>
Apr 12 00:31:26 user nova-compute[82394]:     </serial>
Apr 12 00:31:26 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:26 user nova-compute[82394]:     <video>
Apr 12 00:31:26 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:26 user nova-compute[82394]:     </video>
Apr 12 00:31:26 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:26 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:26 user nova-compute[82394]:     </rng>
Apr 12 00:31:26 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:26 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:26 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:26 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:26 user nova-compute[82394]:   </devices>
Apr 12 00:31:26 user nova-compute[82394]: </domain>
Apr 12 00:31:26 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234273224',display_name='tempest-SnapshotDataIntegrityTests-server-234273224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234273224',id=12,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP1c5/DXHZ03s6Jdn9okYMn378SHeUgFUdyzdwxHtCPGziXx0bIkFiht3GzYK2UQV1ksfRO+sxkDOUgz1Da1rC/+VwIe2/nk+J4nKbMkEnpWPIkQxI6eGb5x1NRAtYWkw==',key_name='tempest-SnapshotDataIntegrityTests-1604911239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12eca8b17b844a8821294ec9dd19de8',ramdisk_id='',reservation_id='r-50ifr5ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-282769033',owner_user_name='tempest-SnapshotDataIntegrityTests-282769033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:20Z,user_data=None,user_id='c5219586e4e24c33a8cdf52c21d875bd',uuid=9d67708d-1bcf-4d32-8d45-22376ec72e34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converting VIF {"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_vif [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34faa1f7-7c, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34faa1f7-7c, col_values=(('external_ids', {'iface-id': '34faa1f7-7c0e-4272-a3b6-092979dd46b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:bd:d4', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71a3bef9-13, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71a3bef9-13, col_values=(('external_ids', {'iface-id': '71a3bef9-13f4-4aab-ba85-a26faa225efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:aa:95', 'vm-uuid': '9d67708d-1bcf-4d32-8d45-22376ec72e34'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a80b7d7-aa, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a80b7d7-aa, col_values=(('external_ids', {'iface-id': '4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b6:ff', 'vm-uuid': 'e3b52368-86be-4211-a37b-522ed3991a00'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_vif [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa')
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No VIF found with MAC fa:16:3e:ad:aa:95, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance network_info: |[{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.network.neutron [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port 9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Start _get_guest_xml network_info=[{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9130096d-4645-4908-ba47-1fba4e7813c2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuQsODCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f784806a-987f-4861-a23a-dbf961c8b6c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 'serial': 'b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': 'a88ffad0-b2e4-4182-857f-ecb16c89d6c6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYHfuyIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f784806a-987f-4861-a23a-dbf961c8b6c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c85736f3-0744-49a3-a4b9-c65987e67df4', 'serial': 'c85736f3-0744-49a3-a4b9-c65987e67df4'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': 'cddb7e06-fedd-44cd-a7d9-9c3511a24844', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkRbQNEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f784806a-987f-4861-a23a-dbf961c8b6c1', 'attached_at': '', 'detached_at': '', 'volume_id': '7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 'serial': '7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuQsODCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:26 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] No BDM found with device name hda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] No VIF found with MAC fa:16:3e:a8:a1:62, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] No VIF found with MAC fa:16:3e:b7:7e:c2, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Using config drive
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861dedc-63f6-4ccf-8ac7-8ef29300d2c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:26 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64807c99-ecfd-4d5e-b82d-314c8f450e3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0] added
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb91fd-723f-4d74-8036-1037bc631119]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfba742-0382-4c8b-8d3c-1e0c2e180d3a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xuQsODCA {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xuQsODCA" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e1d812-1986-422f-bf5c-d72c45bc0e68]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xuQsODCA'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c4c53-d8f6-43a4-8d5a-62edfbf08892]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[03110101-0ddc-41e2-a1af-fd95ac0050fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3530c2-4a41-4f03-a829-d05bf1db1074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260]
Apr 12 00:31:26 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c01b2a4-0060-401a-80a1-e9f7949d97d9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefadae-199b-4142-8f51-5a95b539457a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4d132b-ed9b-4486-a374-004f5c907fec]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuQsODCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Creating config drive at /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/disk.config
Apr 12 00:31:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpicvmu7hp {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updated VIF entry in instance network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating instance_info_cache with network_info: [{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpicvmu7hp" returned: 0 in 0.065s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Releasing lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updated VIF entry in instance network info cache for port 9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23662373562366361', 'path': '/dev/sdf'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662373562366361', 'path': '/dev/sdf'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYHfuyIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:27 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:27 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:27 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92564e7b-f7b7-4921-9216-83e2184beef8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:28 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e32ac3-ad9d-4a6b-bb4b-47c649b5a909]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4] added
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad3802-40b9-411b-ad8c-06c0ab079436]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cbc0cf-447e-43a6-b67a-85f005ddca4c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYHfuyIL {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updated VIF entry in instance network info cache for port f9be977e-033f-44cb-adda-1590a13ccbdb. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG nova.network.neutron [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYHfuyIL" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf256d33-c2d3-4d70-87ff-67195c986c32]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYHfuyIL'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc071a-60bd-4e84-89a8-38093f840eaa]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe757faa-660d-49a9-87a3-4f8a6802932e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea995a2b-060b-45f6-9164-b2f9dca6d79c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260]
Apr 12 00:31:28 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[68130543-c0ac-47b0-a065-458c681ff039]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3c8202-ad73-45bb-9a5b-27aaea6963c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[509560fa-a3dc-4a8a-87cc-f1466e062961]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYHfuyIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:31:29 user nova-compute[82394]: INFO nova.compute.claims [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Claim successful on node user
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26361666261323136', 'path': '/dev/sdg'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361666261323136', 'path': '/dev/sdg'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkRbQNEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:29 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbfd007-75ee-472a-95a3-b6ad3fb9066d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:29 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ffad65-e0d9-49ba-ad6a-300b70a6145c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5] added
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] No waiting events found dispatching network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:29 user nova-compute[82394]: WARNING nova.compute.manager [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received unexpected event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb for instance with vm_state building and task_state spawning.
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9881308-3d8f-447a-8f75-656839474eba]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea48eb-80ff-447a-af9a-07cdf29561b0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkRbQNEw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkRbQNEw" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3f7ce-4d62-4f42-9bc8-1e32f7fde789]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkRbQNEw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f5851-e4bd-4f02-abcd-5cb89a713587]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[769713b3-2f3e-400c-9f4a-d27b707c0344]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ab39a7-3710-489a-bcd5-3a0c7fbae8f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260]
Apr 12 00:31:29 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[950954a8-933a-4a2b-8c82-ce62452d2fda]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b852af-d4e2-49d8-9aed-3a77e91846ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a03de4-f884-47d5-9ddb-162176b3644d]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:29 user nova-compute[82394]: INFO nova.virt.block_device [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Booting with volume 8d0a089d-f950-4c30-a68f-7511646878fb at /dev/vda
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.policy [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.utils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bffe8c-99b6-4a5f-9a14-e45ea57afed5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fee103-c038-4369-a1bf-f114a5555013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab2c58d-ffca-4dba-8e92-d67109babb0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece7f90-e908-4d85-9934-dc4c51ff9f5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:31:30 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a3244-01f4-40a3-9cc8-2554d39dbdcd]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.utils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== get_connector_properties: return (263ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating existing volume attachment record: 428149ff-c17f-428a-8afd-4a49a1aea87f {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkRbQNEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23833336436306332', 'path': '/dev/sdh'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833336436306332', 'path': '/dev/sdh'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lazy-loading 'pci_devices' on Instance uuid f784806a-987f-4861-a23a-dbf961c8b6c1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:31 user nova-compute[82394]:   <uuid>f784806a-987f-4861-a23a-dbf961c8b6c1</uuid>
Apr 12 00:31:31 user nova-compute[82394]:   <name>instance-00000009</name>
Apr 12 00:31:31 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:31 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:31 user nova-compute[82394]:   <metadata>
Apr 12 00:31:31 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:31 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:name>tempest-device-tagging-server-1045274061</nova:name>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:26</nova:creationTime>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:31 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:31 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:user uuid="df6b3a1f732c47e1aaa08b26056695d3">tempest-TaggedBootDevicesTest-801742631-project-member</nova:user>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:project uuid="b6b2a25677e14a23ae7b81e2e56c008a">tempest-TaggedBootDevicesTest-801742631</nova:project>
Apr 12 00:31:31 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:31 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="09b82fec-ca71-4934-ac24-073ca9080c9c">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="0b6ea381-2a40-4f39-a8a5-88a31565ea17">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="8d5703b7-ffc6-4337-9cbe-98328e04c0eb">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="bb8ab354-dbbc-4141-9499-5689ae95fb2f">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="f9be977e-033f-44cb-adda-1590a13ccbdb">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="f528d725-8cc8-49c2-8e45-56340893e4c7">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:         <nova:port uuid="9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b">
Apr 12 00:31:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 00:31:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:31 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:31 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:31 user nova-compute[82394]:   </metadata>
Apr 12 00:31:31 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:31 user nova-compute[82394]:     <system>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="serial">f784806a-987f-4861-a23a-dbf961c8b6c1</entry>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="uuid">f784806a-987f-4861-a23a-dbf961c8b6c1</entry>
Apr 12 00:31:31 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:31 user nova-compute[82394]:     </system>
Apr 12 00:31:31 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:31 user nova-compute[82394]:   <os>
Apr 12 00:31:31 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:31 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:31 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:31 user nova-compute[82394]:   </os>
Apr 12 00:31:31 user nova-compute[82394]:   <features>
Apr 12 00:31:31 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:31 user nova-compute[82394]:     <apic/>
Apr 12 00:31:31 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:31 user nova-compute[82394]:   </features>
Apr 12 00:31:31 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:31 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:31 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:31 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:31 user nova-compute[82394]:   </clock>
Apr 12 00:31:31 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:31 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:31 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:31 user nova-compute[82394]:   </cpu>
Apr 12 00:31:31 user nova-compute[82394]:   <devices>
Apr 12 00:31:31 user nova-compute[82394]:     <disk type="file" device="cdrom">
Apr 12 00:31:31 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 00:31:31 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/disk.config"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="hda" bus="ide"/>
Apr 12 00:31:31 user nova-compute[82394]:     </disk>
Apr 12 00:31:31 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:31 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:31 user nova-compute[82394]:       <source dev="/dev/sdf"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <serial>b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0</serial>
Apr 12 00:31:31 user nova-compute[82394]:     </disk>
Apr 12 00:31:31 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:31 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:31 user nova-compute[82394]:       <source dev="/dev/sdg"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <serial>c85736f3-0744-49a3-a4b9-c65987e67df4</serial>
Apr 12 00:31:31 user nova-compute[82394]:     </disk>
Apr 12 00:31:31 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:31 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:31 user nova-compute[82394]:       <source dev="/dev/sdh"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="vdc" bus="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <serial>7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5</serial>
Apr 12 00:31:31 user nova-compute[82394]:     </disk>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:df:98:aa"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tap09b82fec-ca"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:db:22:c5"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tap0b6ea381-2a"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:c7:09:72"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tap8d5703b7-ff"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:f9:32:c4"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tapbb8ab354-db"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:7b:7b:73"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tapf9be977e-03"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:1a:f8:fe"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tapf528d725-8c"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:31 user nova-compute[82394]:       <mac address="fa:16:3e:70:d8:06"/>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:31 user nova-compute[82394]:       <target dev="tap9d9fcf83-a9"/>
Apr 12 00:31:31 user nova-compute[82394]:     </interface>
Apr 12 00:31:31 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:31 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/console.log" append="off"/>
Apr 12 00:31:31 user nova-compute[82394]:     </serial>
Apr 12 00:31:31 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:31 user nova-compute[82394]:     <video>
Apr 12 00:31:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:31 user nova-compute[82394]:     </video>
Apr 12 00:31:31 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:31 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:31 user nova-compute[82394]:     </rng>
Apr 12 00:31:31 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:31 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:31 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:31 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:31 user nova-compute[82394]:   </devices>
Apr 12 00:31:31 user nova-compute[82394]: </domain>
Apr 12 00:31:31 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b82fec-ca, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09b82fec-ca, col_values=(('external_ids', {'iface-id': '09b82fec-ca71-4934-ac24-073ca9080c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:98:aa', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca')
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b6ea381-2a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b6ea381-2a, col_values=(('external_ids', {'iface-id': '0b6ea381-2a40-4f39-a8a5-88a31565ea17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:22:c5', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a')
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d5703b7-ff, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d5703b7-ff, col_values=(('external_ids', {'iface-id': '8d5703b7-ffc6-4337-9cbe-98328e04c0eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:09:72', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff')
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb8ab354-db, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb8ab354-db, col_values=(('external_ids', {'iface-id': 'bb8ab354-dbbc-4141-9499-5689ae95fb2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:32:c4', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db')
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9be977e-03, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9be977e-03, col_values=(('external_ids', {'iface-id': 'f9be977e-033f-44cb-adda-1590a13ccbdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:7b:73', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Successfully created port: b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] No waiting events found dispatching network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received unexpected event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:31 user nova-compute[82394]: WARNING nova.compute.manager [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 for instance with vm_state building and task_state spawning.
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03')
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf528d725-8c, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf528d725-8c, col_values=(('external_ids', {'iface-id': 'f528d725-8cc8-49c2-8e45-56340893e4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:f8:fe', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c')
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d9fcf83-a9, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d9fcf83-a9, col_values=(('external_ids', {'iface-id': '9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:d8:06', 'vm-uuid': 'f784806a-987f-4861-a23a-dbf961c8b6c1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: INFO os_vif [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9')
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] No BDM found with device name hda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] No VIF found with MAC fa:16:3e:df:98:aa, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] No VIF found with MAC fa:16:3e:7b:7b:73, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:32 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Using config drive
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Creating config drive at /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/disk.config
Apr 12 00:31:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbvxv0nu5 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Successfully updated port: b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbvxv0nu5" returned: 0 in 0.056s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259493.012561, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] VM Resumed (Lifecycle Event)
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Instance spawned successfully.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:33 user nova-compute[82394]: WARNING nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 for instance with vm_state building and task_state spawning.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:33 user nova-compute[82394]: WARNING nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance with vm_state building and task_state spawning.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing instance network info cache due to event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259493.0129764, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] VM Started (Lifecycle Event)
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Took 12.84 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance network_info: |[{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:33 user nova-compute[82394]: INFO nova.compute.manager [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Took 13.93 seconds to build instance.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.040s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:33 user nova-compute[82394]: WARNING nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 for instance with vm_state building and task_state spawning.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:33 user nova-compute[82394]: WARNING nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance with vm_state building and task_state spawning.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:33 user nova-compute[82394]: WARNING nova.compute.manager [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance with vm_state building and task_state spawning.
Apr 12 00:31:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updated VIF entry in instance network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:34 user nova-compute[82394]: WARNING nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance with vm_state building and task_state spawning.
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:34 user nova-compute[82394]: WARNING nova.compute.manager [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance with vm_state building and task_state spawning.
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259494.754223, e3b52368-86be-4211-a37b-522ed3991a00 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] VM Resumed (Lifecycle Event)
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance spawned successfully.
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259494.7672446, e3b52368-86be-4211-a37b-522ed3991a00 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] VM Started (Lifecycle Event)
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:35 user nova-compute[82394]: INFO nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Took 23.83 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: INFO nova.compute.manager [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Took 42.51 seconds to build instance.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance with vm_state active and task_state None.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c for instance with vm_state building and task_state spawning.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c for instance with vm_state building and task_state spawning.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.compute.manager [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance with vm_state building and task_state spawning.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.731s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.compute.manager [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance with vm_state building and task_state spawning.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Creating image(s)
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Ensure instance console log exists: /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start _get_guest_xml network_info=[{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '428149ff-c17f-428a-8afd-4a49a1aea87f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19cc71e1-9b01-4bfd-9898-14b04bfe5fff', 'attached_at': '', 'detached_at': '', 'volume_id': '8d0a089d-f950-4c30-a68f-7511646878fb', 'serial': '8d0a089d-f950-4c30-a68f-7511646878fb'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:35 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:31:35 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a1b988-7e9a-478e-88fe-bb0ad3ed2cc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:31:35 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f12c226-570d-43d8-85a2-6be7ea48d971]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb] added
Apr 12 00:31:35 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a3e22-619a-4233-a465-4ee8eba49ba5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a4775-6728-4695-9bad-168254d29d1d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEmcGxDg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEmcGxDg" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f1678-a8eb-4431-9608-45ae028f9d9a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEmcGxDg'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0418295-0217-443b-abac-03a31f2726aa]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc3f39-5e99-4a6e-ad43-5a6a8b2d157d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04f0193-ca89-4ce7-a942-ace31ac847f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]
Apr 12 00:31:36 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.
Apr 12 00:31:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c47d9e-f5e8-4d47-9999-40fdf4de3015]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb323b3-ad4a-4740-90a2-c40d4ef130c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:31:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:31:36 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:31:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa3c765-149a-446d-a627-37fb697fdccc]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:36 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:31:36 user nova-compute[82394]: INFO nova.compute.claims [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Claim successful on node user
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.913s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== connect_volume: return (1558ms) {'type': 'block', 'scsi_wwn': '23437343265363431', 'path': '/dev/sdi'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437343265363431', 'path': '/dev/sdi'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:31:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAGdsPc2kkKFJoMoObq2mhf3wSWiVrIpEKF85Yl7zW57cuaGGXxZfMd81KN/RMSzVQbf9duu6jwp+9gjp4UDunIsZZRYk1GjUolkdqpAK7Qa3hIBA+9wz/IhHmwfXa5Kg==',key_name='tempest-TestShelveInstance-382306594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:30Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'pci_devices' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:37 user nova-compute[82394]:   <uuid>19cc71e1-9b01-4bfd-9898-14b04bfe5fff</uuid>
Apr 12 00:31:37 user nova-compute[82394]:   <name>instance-0000000d</name>
Apr 12 00:31:37 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:37 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:37 user nova-compute[82394]:   <metadata>
Apr 12 00:31:37 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:37 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:37 user nova-compute[82394]:       <nova:name>tempest-TestShelveInstance-server-1609521830</nova:name>
Apr 12 00:31:37 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:35</nova:creationTime>
Apr 12 00:31:37 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:37 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:37 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:37 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:user uuid="391e2cd0c34b4e838c4cf86ba933270c">tempest-TestShelveInstance-431446894-project-member</nova:user>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:project uuid="b7bc7149e49343889c32fc198b6a0500">tempest-TestShelveInstance-431446894</nova:project>
Apr 12 00:31:37 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:37 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:37 user nova-compute[82394]:         <nova:port uuid="b796ef8b-d964-459f-b12c-9be0133dd643">
Apr 12 00:31:37 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:31:37 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:37 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:37 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:37 user nova-compute[82394]:   </metadata>
Apr 12 00:31:37 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:37 user nova-compute[82394]:     <system>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="serial">19cc71e1-9b01-4bfd-9898-14b04bfe5fff</entry>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="uuid">19cc71e1-9b01-4bfd-9898-14b04bfe5fff</entry>
Apr 12 00:31:37 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:37 user nova-compute[82394]:     </system>
Apr 12 00:31:37 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:37 user nova-compute[82394]:   <os>
Apr 12 00:31:37 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:37 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:37 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:37 user nova-compute[82394]:   </os>
Apr 12 00:31:37 user nova-compute[82394]:   <features>
Apr 12 00:31:37 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:37 user nova-compute[82394]:     <apic/>
Apr 12 00:31:37 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:37 user nova-compute[82394]:   </features>
Apr 12 00:31:37 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:37 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:37 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:37 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:37 user nova-compute[82394]:   </clock>
Apr 12 00:31:37 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:37 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:37 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:37 user nova-compute[82394]:   </cpu>
Apr 12 00:31:37 user nova-compute[82394]:   <devices>
Apr 12 00:31:37 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:31:37 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:31:37 user nova-compute[82394]:       <source dev="/dev/sdi"/>
Apr 12 00:31:37 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:37 user nova-compute[82394]:       <serial>8d0a089d-f950-4c30-a68f-7511646878fb</serial>
Apr 12 00:31:37 user nova-compute[82394]:     </disk>
Apr 12 00:31:37 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:37 user nova-compute[82394]:       <mac address="fa:16:3e:7e:89:9d"/>
Apr 12 00:31:37 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:37 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:37 user nova-compute[82394]:       <target dev="tapb796ef8b-d9"/>
Apr 12 00:31:37 user nova-compute[82394]:     </interface>
Apr 12 00:31:37 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:37 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/console.log" append="off"/>
Apr 12 00:31:37 user nova-compute[82394]:     </serial>
Apr 12 00:31:37 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:37 user nova-compute[82394]:     <video>
Apr 12 00:31:37 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:37 user nova-compute[82394]:     </video>
Apr 12 00:31:37 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:37 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:37 user nova-compute[82394]:     </rng>
Apr 12 00:31:37 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:37 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:37 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:37 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:37 user nova-compute[82394]:   </devices>
Apr 12 00:31:37 user nova-compute[82394]: </domain>
Apr 12 00:31:37 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAGdsPc2kkKFJoMoObq2mhf3wSWiVrIpEKF85Yl7zW57cuaGGXxZfMd81KN/RMSzVQbf9duu6jwp+9gjp4UDunIsZZRYk1GjUolkdqpAK7Qa3hIBA+9wz/IhHmwfXa5Kg==',key_name='tempest-TestShelveInstance-382306594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:30Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG os_vif [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb796ef8b-d9, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb796ef8b-d9, col_values=(('external_ids', {'iface-id': 'b796ef8b-d964-459f-b12c-9be0133dd643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:89:9d', 'vm-uuid': '19cc71e1-9b01-4bfd-9898-14b04bfe5fff'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: INFO os_vif [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9')
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.policy [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:31:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Creating image(s)
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "/opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "/opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "/opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] No VIF found with MAC fa:16:3e:7e:89:9d, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:37 user nova-compute[82394]: WARNING nova.compute.manager [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb for instance with vm_state building and task_state spawning.
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.203s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk 1073741824" returned: 0 in 0.081s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Successfully created port: 6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Cannot resize image /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.objects.instance [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'migration_context' on Instance uuid 570abef1-f803-4f3e-8051-b6f690063496 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Ensure instance console log exists: /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259499.183015, f784806a-987f-4861-a23a-dbf961c8b6c1 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] VM Resumed (Lifecycle Event)
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Successfully updated port: 6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance spawned successfully.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquired lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:39 user nova-compute[82394]: WARNING nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 for instance with vm_state building and task_state spawning.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:39 user nova-compute[82394]: WARNING nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance with vm_state building and task_state spawning.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:39 user nova-compute[82394]: WARNING nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance with vm_state building and task_state spawning.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-changed-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Refreshing instance network info cache due to event network-changed-6e0b9ee8-e941-48ea-9659-8e837577d4bb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquiring lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259499.1831887, f784806a-987f-4861-a23a-dbf961c8b6c1 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] VM Started (Lifecycle Event)
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Took 28.40 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: INFO nova.compute.manager [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Took 45.02 seconds to build instance.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.126s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Updating instance_info_cache with network_info: [{"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Releasing lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Instance network_info: |[{"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquired lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.neutron [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Refreshing network info cache for port 6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Start _get_guest_xml network_info=[{"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:39 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:39 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909783913',display_name='tempest-ServersNegativeTestJSON-server-909783913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909783913',id=14,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-bta30xjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:38Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=570abef1-f803-4f3e-8051-b6f690063496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.objects.instance [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'pci_devices' on Instance uuid 570abef1-f803-4f3e-8051-b6f690063496 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:39 user nova-compute[82394]:   <uuid>570abef1-f803-4f3e-8051-b6f690063496</uuid>
Apr 12 00:31:39 user nova-compute[82394]:   <name>instance-0000000e</name>
Apr 12 00:31:39 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:39 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:39 user nova-compute[82394]:   <metadata>
Apr 12 00:31:39 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:39 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:name>tempest-ServersNegativeTestJSON-server-909783913</nova:name>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:39</nova:creationTime>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:39 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:39 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:user uuid="920d6d79e38e45fcb5153e712605764f">tempest-ServersNegativeTestJSON-103053763-project-member</nova:user>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:project uuid="6ee31cdc6f4e4c2b9a8ec1e1c5076010">tempest-ServersNegativeTestJSON-103053763</nova:project>
Apr 12 00:31:39 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:39 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:39 user nova-compute[82394]:         <nova:port uuid="6e0b9ee8-e941-48ea-9659-8e837577d4bb">
Apr 12 00:31:39 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:31:39 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:39 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:39 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:39 user nova-compute[82394]:   </metadata>
Apr 12 00:31:39 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:39 user nova-compute[82394]:     <system>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="serial">570abef1-f803-4f3e-8051-b6f690063496</entry>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="uuid">570abef1-f803-4f3e-8051-b6f690063496</entry>
Apr 12 00:31:39 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:39 user nova-compute[82394]:     </system>
Apr 12 00:31:39 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:39 user nova-compute[82394]:   <os>
Apr 12 00:31:39 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:39 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:31:39 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:39 user nova-compute[82394]:   </os>
Apr 12 00:31:39 user nova-compute[82394]:   <features>
Apr 12 00:31:39 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:39 user nova-compute[82394]:     <apic/>
Apr 12 00:31:39 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:39 user nova-compute[82394]:   </features>
Apr 12 00:31:39 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:39 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:39 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:39 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:39 user nova-compute[82394]:   </clock>
Apr 12 00:31:39 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:39 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:39 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:39 user nova-compute[82394]:   </cpu>
Apr 12 00:31:39 user nova-compute[82394]:   <devices>
Apr 12 00:31:39 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:31:39 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:31:39 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk"/>
Apr 12 00:31:39 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:39 user nova-compute[82394]:     </disk>
Apr 12 00:31:39 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:39 user nova-compute[82394]:       <mac address="fa:16:3e:cd:55:1a"/>
Apr 12 00:31:39 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:39 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:39 user nova-compute[82394]:       <target dev="tap6e0b9ee8-e9"/>
Apr 12 00:31:39 user nova-compute[82394]:     </interface>
Apr 12 00:31:39 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:39 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/console.log" append="off"/>
Apr 12 00:31:39 user nova-compute[82394]:     </serial>
Apr 12 00:31:39 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:39 user nova-compute[82394]:     <video>
Apr 12 00:31:39 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:39 user nova-compute[82394]:     </video>
Apr 12 00:31:39 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:39 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:39 user nova-compute[82394]:     </rng>
Apr 12 00:31:39 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:39 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:39 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:39 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:39 user nova-compute[82394]:   </devices>
Apr 12 00:31:39 user nova-compute[82394]: </domain>
Apr 12 00:31:39 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909783913',display_name='tempest-ServersNegativeTestJSON-server-909783913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909783913',id=14,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-bta30xjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:31:38Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=570abef1-f803-4f3e-8051-b6f690063496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG os_vif [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e0b9ee8-e9, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e0b9ee8-e9, col_values=(('external_ids', {'iface-id': '6e0b9ee8-e941-48ea-9659-8e837577d4bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:55:1a', 'vm-uuid': '570abef1-f803-4f3e-8051-b6f690063496'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:31:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:39 user nova-compute[82394]: INFO os_vif [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9')
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:40 user nova-compute[82394]: WARNING nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state building and task_state spawning.
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:40 user nova-compute[82394]: WARNING nova.compute.manager [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state building and task_state spawning.
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] No VIF found with MAC fa:16:3e:cd:55:1a, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.network.neutron [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Updated VIF entry in instance network info cache for port 6e0b9ee8-e941-48ea-9659-8e837577d4bb. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.network.neutron [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Updating instance_info_cache with network_info: [{"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Releasing lock "refresh_cache-570abef1-f803-4f3e-8051-b6f690063496" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:40 user nova-compute[82394]: INFO nova.compute.manager [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Rescuing
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:40 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] No waiting events found dispatching network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:41 user nova-compute[82394]: WARNING nova.compute.manager [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received unexpected event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance with vm_state building and task_state spawning.
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259501.9736714, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:41 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Resumed (Lifecycle Event)
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:41 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance spawned successfully.
Apr 12 00:31:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259501.9749005, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Started (Lifecycle Event)
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Took 6.25 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.compute.manager [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Took 13.20 seconds to build instance.
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.320s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance destroyed successfully.
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Attempting rescue
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Creating image(s)
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.175s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue" returned: 0 in 0.050s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start _get_guest_xml network_info=[{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:de:53:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'numa_topology' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609902258',display_name='tempest-ServerRescueNegativeTestJSON-server-1609902258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609902258',id=3,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-1zbegtx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:05Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=0334c8b1-3d0e-4af5-b86f-a6b41a3d6050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:de:53:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:de:53:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:31:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:31:42 user nova-compute[82394]:   <uuid>0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</uuid>
Apr 12 00:31:42 user nova-compute[82394]:   <name>instance-00000003</name>
Apr 12 00:31:42 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:31:42 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:31:42 user nova-compute[82394]:   <metadata>
Apr 12 00:31:42 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:31:42 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1609902258</nova:name>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:31:42</nova:creationTime>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:31:42 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:31:42 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:owner>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:31:42 user nova-compute[82394]:       </nova:owner>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:31:42 user nova-compute[82394]:       <nova:ports>
Apr 12 00:31:42 user nova-compute[82394]:         <nova:port uuid="8cb07b1c-aa00-4fcf-983c-4b42566ef948">
Apr 12 00:31:42 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 00:31:42 user nova-compute[82394]:         </nova:port>
Apr 12 00:31:42 user nova-compute[82394]:       </nova:ports>
Apr 12 00:31:42 user nova-compute[82394]:     </nova:instance>
Apr 12 00:31:42 user nova-compute[82394]:   </metadata>
Apr 12 00:31:42 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:31:42 user nova-compute[82394]:     <system>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="serial">0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</entry>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="uuid">0334c8b1-3d0e-4af5-b86f-a6b41a3d6050</entry>
Apr 12 00:31:42 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:31:42 user nova-compute[82394]:     </system>
Apr 12 00:31:42 user nova-compute[82394]:   </sysinfo>
Apr 12 00:31:42 user nova-compute[82394]:   <os>
Apr 12 00:31:42 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:31:42 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:31:42 user nova-compute[82394]:   </os>
Apr 12 00:31:42 user nova-compute[82394]:   <features>
Apr 12 00:31:42 user nova-compute[82394]:     <acpi/>
Apr 12 00:31:42 user nova-compute[82394]:     <apic/>
Apr 12 00:31:42 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:31:42 user nova-compute[82394]:   </features>
Apr 12 00:31:42 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:31:42 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:31:42 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:31:42 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:31:42 user nova-compute[82394]:   </clock>
Apr 12 00:31:42 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:31:42 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:31:42 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:31:42 user nova-compute[82394]:   </cpu>
Apr 12 00:31:42 user nova-compute[82394]:   <devices>
Apr 12 00:31:42 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:31:42 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:31:42 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue"/>
Apr 12 00:31:42 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:31:42 user nova-compute[82394]:     </disk>
Apr 12 00:31:42 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:31:42 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:31:42 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk"/>
Apr 12 00:31:42 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:31:42 user nova-compute[82394]:     </disk>
Apr 12 00:31:42 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:31:42 user nova-compute[82394]:       <mac address="fa:16:3e:de:53:f8"/>
Apr 12 00:31:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:42 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:31:42 user nova-compute[82394]:       <target dev="tap8cb07b1c-aa"/>
Apr 12 00:31:42 user nova-compute[82394]:     </interface>
Apr 12 00:31:42 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:31:42 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/console.log" append="off"/>
Apr 12 00:31:42 user nova-compute[82394]:     </serial>
Apr 12 00:31:42 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:31:42 user nova-compute[82394]:     <video>
Apr 12 00:31:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:31:42 user nova-compute[82394]:     </video>
Apr 12 00:31:42 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:31:42 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:31:42 user nova-compute[82394]:     </rng>
Apr 12 00:31:42 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:31:42 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:31:42 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:31:42 user nova-compute[82394]:     </memballoon>
Apr 12 00:31:42 user nova-compute[82394]:   </devices>
Apr 12 00:31:42 user nova-compute[82394]: </domain>
Apr 12 00:31:42 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:31:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance destroyed successfully.
Apr 12 00:31:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:de:53:f8, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:43 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] No waiting events found dispatching network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:44 user nova-compute[82394]: WARNING nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received unexpected event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance with vm_state building and task_state spawning.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:44 user nova-compute[82394]: WARNING nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state active and task_state rescuing.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:44 user nova-compute[82394]: WARNING nova.compute.manager [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state active and task_state rescuing.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259504.0680954, 570abef1-f803-4f3e-8051-b6f690063496 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] VM Resumed (Lifecycle Event)
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Instance spawned successfully.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259504.0728993, 570abef1-f803-4f3e-8051-b6f690063496 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] VM Started (Lifecycle Event)
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Took 6.57 seconds to spawn the instance on the hypervisor.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:44 user nova-compute[82394]: INFO nova.compute.manager [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Took 7.97 seconds to build instance.
Apr 12 00:31:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.103s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:46 user nova-compute[82394]: WARNING nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state active and task_state rescuing.
Apr 12 00:31:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:31:46 user nova-compute[82394]: WARNING nova.compute.manager [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state active and task_state rescuing.
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259507.2160938, 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:47 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] VM Resumed (Lifecycle Event)
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:47 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259507.2173, 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:31:47 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] VM Started (Lifecycle Event)
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-changed-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Refreshing instance network info cache due to event network-changed-b99b54c2-0b21-42ea-91d0-087aa230da7e. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Refreshing network info cache for port b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updated VIF entry in instance network info cache for port b99b54c2-0b21-42ea-91d0-087aa230da7e. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:31:52 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:52 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=26.593963623046875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 570abef1-f803-4f3e-8051-b6f690063496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance db3a1291-c686-4e29-8499-8d49dd74a7bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f784806a-987f-4861-a23a-dbf961c8b6c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 5be536dd-61f5-4a17-a734-029b25739a47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance e3b52368-86be-4211-a37b-522ed3991a00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 7f1f85bf-03e5-493e-b187-955998b020ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f9dc12da-4db1-4305-93ea-2bd63870c097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:31:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:31:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:31:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:31:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:31:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:31:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:31:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:31:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:31:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:31:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:31:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-changed-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Refreshing instance network info cache due to event network-changed-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Acquiring lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Acquired lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG nova.network.neutron [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Refreshing network info cache for port bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG nova.objects.instance [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'flavor' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:15 user nova-compute[82394]: INFO nova.compute.manager [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attaching volume 65678a70-1c74-42ac-9334-dd959c1ea80f to /dev/vdb
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.utils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e008fdc0-24fb-4384-ba2d-0819f31f2a2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG nova.network.neutron [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updated VIF entry in instance network info cache for port bb2a7afd-3e9c-4291-82ff-c443bee5c1f9. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG nova.network.neutron [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating instance_info_cache with network_info: [{"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Releasing lock "refresh_cache-5be536dd-61f5-4a17-a734-029b25739a47" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b555f2c-28c7-4be6-9faf-1fb0f0e8d46b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00e2bb-329a-4e5f-afae-3c887493cb80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dfcfb7-1163-4389-a57f-349b549d4f7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:15 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04680b7b-fa7c-4bbc-b37a-9de5cd1753d5]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG os_brick.utils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:15 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating existing volume attachment record: c53ca735-67a2-400d-84a4-33cb0fd261c0 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:32:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-changed-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Refreshing instance network info cache due to event network-changed-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Acquiring lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Acquired lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Refreshing network info cache for port 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updated VIF entry in instance network info cache for port 7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updating instance_info_cache with network_info: [{"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Releasing lock "refresh_cache-db3a1291-c686-4e29-8499-8d49dd74a7bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'flavor' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:19 user nova-compute[82394]: INFO nova.compute.manager [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Attaching volume 9921d0be-3070-4605-a1f0-eb4e10a6fb02 to /dev/sdc
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.utils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[23958192-6847-48ba-a0fe-6bbf077e4f40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12cbeb-a602-4db0-96d6-c026d73a7aca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1916ba-e088-4841-b959-3fbcb43b4e82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d9885-2b8d-4235-a0bd-22da14c0213b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:19 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b443c3-c7e9-4043-9e94-818bc6ea75bf]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.utils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updating existing volume attachment record: 72be60e5-fadd-4a85-85df-e68c47dff228 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:19 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260" returned: 21 in 0.104s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fc1ed7-0c66-4b41-8d82-0b096515c0ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:32:19 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a17f24-462c-4844-bb60-8aacc9940b23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f] added
Apr 12 00:32:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1704cd-5a7e-466b-80d2-8aba2794b659]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-changed-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing instance network info cache due to event network-changed-47b92afd-7a5c-49a0-aea8-abccac5e350c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing network info cache for port 47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a223b27b-dbca-4ab8-8e94-c71a3fbf45ae]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yklhTIte {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yklhTIte" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce5c91-6386-4be0-9018-d9827be5fb12]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yklhTIte'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c55e65-51ac-43e6-b202-c2073fcd7037]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b5976-8c7e-44de-80ad-43a425914729]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caebc52-0de8-4a22-8009-4c147738d4ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]
Apr 12 00:32:20 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060c9d8-2f66-494e-bb8a-51f7a68e2cee]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26818a4-0fa2-4931-a4a9-dea5da8906c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:20 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe46ab5-c772-4f8b-a4ce-67cb11356f25]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updated VIF entry in instance network info cache for port 47b92afd-7a5c-49a0-aea8-abccac5e350c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'pci_requests' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:32:20 user nova-compute[82394]: DEBUG nova.policy [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '23631353435633933', 'path': '/dev/sdj'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631353435633933', 'path': '/dev/sdj'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'flavor' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:32:21 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:21 user nova-compute[82394]:   <source dev="/dev/sdj"/>
Apr 12 00:32:21 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:21 user nova-compute[82394]:   <serial>65678a70-1c74-42ac-9334-dd959c1ea80f</serial>
Apr 12 00:32:21 user nova-compute[82394]: </disk>
Apr 12 00:32:21 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Successfully created port: 27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] No VIF found with MAC fa:16:3e:bb:9e:ad, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.982s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Successfully updated port: 27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-changed-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing instance network info cache due to event network-changed-27eab0c4-101d-46a5-a472-d7de01ee4f14. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.utils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0428c88-3206-4f03-be41-f7ae20c2ff42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92365066-9954-44eb-a829-64300316bc52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bcbc88-8a50-4408-a650-de673e0c8bc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef745c-90c3-4cc8-9e82-e2ed57b46c8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:23 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b25c18-c49c-4fff-a998-8c6fb08e4939]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_brick.utils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.neutron [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Refreshing network info cache for port 27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG os_vif [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27eab0c4-10, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27eab0c4-10, col_values=(('external_ids', {'iface-id': '27eab0c4-101d-46a5-a472-d7de01ee4f14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4f:fa', 'vm-uuid': 'f9dc12da-4db1-4305-93ea-2bd63870c097'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:23 user nova-compute[82394]: INFO os_vif [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10')
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] attach device xml: <interface type="ethernet">
Apr 12 00:32:23 user nova-compute[82394]:   <mac address="fa:16:3e:9e:4f:fa"/>
Apr 12 00:32:23 user nova-compute[82394]:   <model type="virtio"/>
Apr 12 00:32:23 user nova-compute[82394]:   <mtu size="1442"/>
Apr 12 00:32:23 user nova-compute[82394]:   <target dev="tap27eab0c4-10"/>
Apr 12 00:32:23 user nova-compute[82394]: </interface>
Apr 12 00:32:23 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:23 user nova-compute[82394]: INFO nova.compute.manager [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Swapping volume 65678a70-1c74-42ac-9334-dd959c1ea80f for d3d5ecec-19dc-4989-a561-09ad5028728b
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:24 user nova-compute[82394]: WARNING nova.compute.manager [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance with vm_state active and task_state None.
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name hda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No VIF found with MAC fa:16:3e:89:48:de, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:24 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:24</nova:creationTime>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:24 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:24 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:24 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:24 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:24 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:24 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:24 user nova-compute[82394]:     <nova:port uuid="27eab0c4-101d-46a5-a472-d7de01ee4f14">
Apr 12 00:32:24 user nova-compute[82394]:       <nova:ip type="fixed" address="10.10.10.242" ipVersion="4"/>
Apr 12 00:32:24 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:24 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:24 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:24 user nova-compute[82394]:  {{(pid=82394) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.884s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOaigkNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:24 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:24 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:24 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[510cd6fe-4d67-4eb3-a568-e6c9a76a8520]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:32:24 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.network.neutron [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updated VIF entry in instance network info cache for port 27eab0c4-101d-46a5-a472-d7de01ee4f14. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.network.neutron [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728d41b-a8b0-4833-94a0-006f93a2a750]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02] added
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f92354-47b0-48be-af3b-7a97b926c106]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5f8886-cb61-424f-91ab-da396b11d0c8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOaigkNo {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOaigkNo" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4c2bc0-5393-43ce-8f21-3d04d1af4796]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GOaigkNo'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415fb8c-cb05-4292-b26e-11fc86ef803c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[01568a87-12c8-4f97-87e4-29f1a7527641]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcc0783-5349-429f-83e4-dd21e32a91ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260]
Apr 12 00:32:24 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1944d-72cd-4cbd-9448-a7a88b1dc878]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f9e0c-9a02-42ef-8f81-8451a64b5a76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:24 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a334553-2612-4299-a03a-04586f288b81]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOaigkNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:24 user nova-compute[82394]: INFO nova.compute.manager [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Attaching volume e2052f02-80cb-4f9f-b9d6-e4525e872af4 to /dev/vdb
Apr 12 00:32:24 user nova-compute[82394]: DEBUG os_brick.utils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73443d16-b271-4da2-9953-f7de568d60b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5eff5-58e3-4939-a1e4-eec8588d078c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb513a4-c216-4960-98a0-9466e53ced9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb19ba5-867b-473d-a187-51b695b1d206]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:25 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843f050-e040-4d78-9716-4fb05c5413c6]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating existing volume attachment record: 3da014b4-e626-4e2a-852d-ccfa064a9c13 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '26439356330356537', 'path': '/dev/sdk'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439356330356537', 'path': '/dev/sdk'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'flavor' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:32:25 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:25 user nova-compute[82394]:   <source dev="/dev/sdk"/>
Apr 12 00:32:25 user nova-compute[82394]:   <target dev="sdc" bus="scsi"/>
Apr 12 00:32:25 user nova-compute[82394]:   <serial>9921d0be-3070-4605-a1f0-eb4e10a6fb02</serial>
Apr 12 00:32:25 user nova-compute[82394]:   <address type="drive" controller="0" unit="2"/>
Apr 12 00:32:25 user nova-compute[82394]: </disk>
Apr 12 00:32:25 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:26 user nova-compute[82394]: WARNING nova.compute.manager [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance with vm_state active and task_state None.
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No BDM found with device name sda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] No VIF found with MAC fa:16:3e:b3:4f:d8, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:32:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.121s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:27 user nova-compute[82394]: INFO nova.compute.manager [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Detaching volume 9921d0be-3070-4605-a1f0-eb4e10a6fb02
Apr 12 00:32:27 user nova-compute[82394]: INFO nova.virt.block_device [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Attempting to driver detach volume 9921d0be-3070-4605-a1f0-eb4e10a6fb02 from mountpoint /dev/sdc
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Attempting to detach device sdc from instance db3a1291-c686-4e29-8499-8d49dd74a7bb from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:27 user nova-compute[82394]:   <source dev="/dev/sdk"/>
Apr 12 00:32:27 user nova-compute[82394]:   <target dev="sdc" bus="scsi"/>
Apr 12 00:32:27 user nova-compute[82394]:   <serial>9921d0be-3070-4605-a1f0-eb4e10a6fb02</serial>
Apr 12 00:32:27 user nova-compute[82394]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 00:32:27 user nova-compute[82394]: </disk>
Apr 12 00:32:27 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Successfully detached device sdc from instance db3a1291-c686-4e29-8499-8d49dd74a7bb from the persistent domain config.
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance db3a1291-c686-4e29-8499-8d49dd74a7bb from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:27 user nova-compute[82394]:   <source dev="/dev/sdk"/>
Apr 12 00:32:27 user nova-compute[82394]:   <target dev="sdc" bus="scsi"/>
Apr 12 00:32:27 user nova-compute[82394]:   <serial>9921d0be-3070-4605-a1f0-eb4e10a6fb02</serial>
Apr 12 00:32:27 user nova-compute[82394]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 00:32:27 user nova-compute[82394]: </disk>
Apr 12 00:32:27 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259547.9407833, db3a1291-c686-4e29-8499-8d49dd74a7bb => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:32:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Successfully detached device sdc from instance db3a1291-c686-4e29-8499-8d49dd74a7bb from the live domain config.
Apr 12 00:32:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOaigkNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:27 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d7946-bb42-4eb4-ad64-53503447041b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:27 user nova-compute[82394]: No targets found.
Apr 12 00:32:27 user nova-compute[82394]: iSNS:
Apr 12 00:32:27 user nova-compute[82394]: No targets found.
Apr 12 00:32:27 user nova-compute[82394]: STATIC:
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:27 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:27 user nova-compute[82394]: No targets found.
Apr 12 00:32:27 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:27 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:27 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f12d1-32cb-46c8-bb2c-2c77486ce03c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[904123df-70d2-4cf4-91f4-167800fc007c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23436dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02'): ({'sdk'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Removing single pathed devices sdk {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a086ab8-7482-4896-9048-43d5a27fbd89]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a1938e-e140-4465-a97b-4ce3f1ba256f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Flushing IO for device /dev/sdk {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[845436cd-0360-4a9e-a0e1-6c4008aa2ed0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9ee8d6-40e7-474c-93b7-24dfcf710f77]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] SCSI volumes sdk have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae1862-914b-4b33-8ded-7e21f5d54a08]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a2e9a-0285-47c2-808d-a3ed02e052b7]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260]
Apr 12 00:32:28 user nova-compute[82394]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9921d0be-3070-4605-a1f0-eb4e10a6fb02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[34749e7b-7bf5-4457-843c-50c82d054bab]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] <== disconnect_volume: return (372ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b', 'serial': 'd3d5ecec-19dc-4989-a561-09ad5028728b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': '65678a70-1c74-42ac-9334-dd959c1ea80f', 'serial'} {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:28 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[87001526-efbc-4fba-bad2-b4854bf6a36f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:32:28 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0150a9-c9a5-4cb6-88ed-c6b82b461b8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b] added
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a416230-5cbe-43cf-9661-95303e7d5f3d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758b229-8816-4996-b7f9-20cefe4c5c8a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORInXmgN {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ORInXmgN" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78068df-6feb-4b6e-8567-d8c6af535a83]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ORInXmgN'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[783817e5-daed-499a-8023-052bb362517a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c8fa62-13d8-4173-81de-56a0f2fcbf71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092f2a7-3051-49bd-a12c-a4ac3b95dd3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260]
Apr 12 00:32:28 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[badc302d-410d-4f30-9d06-d80a5e14c029]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6379ef57-a037-407f-a339-24a5389ec6ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:28 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[842285df-fd36-4c8b-ba34-177d3d271ef1]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'flavor' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.880s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'icXZLxSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23436626333383636', 'path': '/dev/sdk'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436626333383636', 'path': '/dev/sdk'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.144s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:29 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lazy-loading 'flavor' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1677d-3be0-460a-9333-4f2cac669a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:32:29 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af5224-a9d2-493b-9505-db126392198c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4] added
Apr 12 00:32:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=82394) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 00:32:29 user nova-compute[82394]: INFO nova.virt.libvirt.host [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] UEFI support detected
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ff6aa-bfa8-4112-a3cc-3c1ef7890e92]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:29 user nova-compute[82394]: INFO nova.compute.manager [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Terminating instance
Apr 12 00:32:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39883503-564b-4800-908c-ca9312aebcdf]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v icXZLxSU {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v icXZLxSU" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8d092-0b25-41ca-8f42-4654f73e8dad]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'icXZLxSU'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4e777-dfc0-4995-b70b-fb6798a24d1e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8846b2-7e0d-4469-be42-c6f954ccb342]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ff383-b2f2-4023-bc27-c3a780958620]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260]
Apr 12 00:32:30 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665d0fe-2c3c-4281-8340-dee990032706]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8197075-9ca5-419e-bd75-7f192c262d6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:30 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9073e35c-fe82-409e-9890-7fc7dad2bce3]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'icXZLxSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-unplugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] No waiting events found dispatching network-vif-unplugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-unplugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Instance destroyed successfully.
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'resources' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1287308895',display_name='tempest-AttachSCSIVolumeTestJSON-server-1287308895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1287308895',id=6,image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWK9ihmxKkdsVErSw7OgZuNUIpL+qTe4ZmI15q/9/+aifoFw87ghSd+P2MBXDve2Z7zrfv9r+02hHhHZyDBer4WWDnGOM/ysnpJg7MD9NC8prdOD/PW1ucWndbOaiUMg==',key_name='tempest-keypair-992126776',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88cf7bd87e954fa892ea0da5332a6589',ramdisk_id='',reservation_id='r-i51id330',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a44d3d49-491b-40c9-8c3b-bc3f938db25c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-540615201',owner_user_name='tempest-AttachSCSIVolumeTestJSON-540615201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31fe897a730b44bb8c8bf9d92938bc9b',uuid=db3a1291-c686-4e29-8499-8d49dd74a7bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converting VIF {"id": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "address": "fa:16:3e:b3:4f:d8", "network": {"id": "1a490074-20a7-48ab-a8e1-1f0eca33c560", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-324383592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88cf7bd87e954fa892ea0da5332a6589", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c91ba2b-6c", "ovs_interfaceid": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG os_vif [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c91ba2b-6c, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:30 user nova-compute[82394]: INFO os_vif [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4f:d8,bridge_name='br-int',has_traffic_filtering=True,id=7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed,network=Network(1a490074-20a7-48ab-a8e1-1f0eca33c560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c91ba2b-6c')
Apr 12 00:32:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Deleting instance files /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb_del
Apr 12 00:32:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Deletion of /opt/stack/data/nova/instances/db3a1291-c686-4e29-8499-8d49dd74a7bb_del complete
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 180355072 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:30 user nova-compute[82394]: INFO nova.compute.manager [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 12 00:32:30 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:32:30 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] <== connect_volume: return (1582ms) {'type': 'block', 'scsi_wwn': '26631393238376237', 'path': '/dev/sdl'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631393238376237', 'path': '/dev/sdl'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:32:31 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:31 user nova-compute[82394]:   <source dev="/dev/sdl"/>
Apr 12 00:32:31 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:31 user nova-compute[82394]:   <serial>e2052f02-80cb-4f9f-b9d6-e4525e872af4</serial>
Apr 12 00:32:31 user nova-compute[82394]: </disk>
Apr 12 00:32:31 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 327155712 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No BDM found with device name hda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] No VIF found with MAC fa:16:3e:89:48:de, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:32:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 504365056 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.164s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Acquiring lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] No waiting events found dispatching network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:32 user nova-compute[82394]: WARNING nova.compute.manager [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received unexpected event network-vif-plugged-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance with vm_state active and task_state deleting.
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:32 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Took 1.73 seconds to deallocate network for instance.
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Received event network-vif-deleted-7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:33 user nova-compute[82394]: INFO nova.compute.manager [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Detaching volume e2052f02-80cb-4f9f-b9d6-e4525e872af4
Apr 12 00:32:33 user nova-compute[82394]: INFO nova.virt.block_device [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Attempting to driver detach volume e2052f02-80cb-4f9f-b9d6-e4525e872af4 from mountpoint /dev/vdb
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Attempting to detach device vdb from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:33 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:33 user nova-compute[82394]:   <source dev="/dev/sdl"/>
Apr 12 00:32:33 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:33 user nova-compute[82394]:   <serial>e2052f02-80cb-4f9f-b9d6-e4525e872af4</serial>
Apr 12 00:32:33 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 00:32:33 user nova-compute[82394]: </disk>
Apr 12 00:32:33 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully detached device vdb from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the persistent domain config.
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:33 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:33 user nova-compute[82394]:   <source dev="/dev/sdl"/>
Apr 12 00:32:33 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:33 user nova-compute[82394]:   <serial>e2052f02-80cb-4f9f-b9d6-e4525e872af4</serial>
Apr 12 00:32:33 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 00:32:33 user nova-compute[82394]: </disk>
Apr 12 00:32:33 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 957349888 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.636s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:33 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Deleted allocations for instance db3a1291-c686-4e29-8499-8d49dd74a7bb
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "db3a1291-c686-4e29-8499-8d49dd74a7bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.664s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259553.8145065, f9dc12da-4db1-4305-93ea-2bd63870c097 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:32:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully detached device vdb from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the live domain config.
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'icXZLxSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:33 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c18ca-33e3-49a0-b278-69b3f75ba584]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:33 user nova-compute[82394]: No targets found.
Apr 12 00:32:33 user nova-compute[82394]: iSNS:
Apr 12 00:32:33 user nova-compute[82394]: No targets found.
Apr 12 00:32:33 user nova-compute[82394]: STATIC:
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:33 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:33 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:33 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:33 user nova-compute[82394]: No targets found.
Apr 12 00:32:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:33 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:33 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb176876-4057-4412-83a1-d2bf34a29390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe2eaae-5065-4258-a511-364750fb3f96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:33 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23436e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4'): ({'sdl'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Removing single pathed devices sdl {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582813c-3dbd-48f2-b60b-14105c32528a]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c2edce-a7d9-43b5-9912-1b70171ddbd2]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Flushing IO for device /dev/sdl {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dea345-5c38-493f-bef7-443af9fdbaa6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[080be654-1a1f-4a5d-9e4d-886ad2316baf]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] SCSI volumes sdl have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd51a1-7582-4aac-9d5c-6dee8d7f8794]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:34 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9699f66c-7206-451b-b5ba-4a95b8637953]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260]
Apr 12 00:32:34 user nova-compute[82394]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2052f02-80cb-4f9f-b9d6-e4525e872af4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffe570-6327-4dbb-a908-25194315a7f4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] <== disconnect_volume: return (384ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.144s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed5c435-728c-4652-a05a-e3e2386883dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:34 user nova-compute[82394]: No targets found.
Apr 12 00:32:34 user nova-compute[82394]: iSNS:
Apr 12 00:32:34 user nova-compute[82394]: No targets found.
Apr 12 00:32:34 user nova-compute[82394]: STATIC:
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:34 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:34 user nova-compute[82394]: No targets found.
Apr 12 00:32:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:34 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:34 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b8262f-488f-47dd-8bee-fa79a84eecac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[104aea19-9a8f-4a78-8b4d-9faca78dfb14]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:34 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343ce830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f'): ({'sdj'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Removing single pathed devices sdj {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c55d279-5b4c-4ff2-8dc6-2f0c8e61b96a]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf168d-532f-4f66-9e60-6c6d8454241e]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Flushing IO for device /dev/sdj {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f9bc4-2bcb-4886-a634-6407aab052d5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b8a54-15f3-4a30-a2e5-1d4c0a57c018]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] SCSI volumes sdj have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[553cd66f-905d-47ad-8c2f-171009b0e166]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3346efa-5fdd-4fed-9f7b-0ef0c3c44f41]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]
Apr 12 00:32:34 user nova-compute[82394]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd5e3c9-4b1d-4435-a3e0-24b27960fa96]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== disconnect_volume: return (520ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b', 'serial'} {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: removing Cinder connection for volume 65678a70-1c74-42ac-9334-dd959c1ea80f {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 00:32:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.014s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: Updating volume 65678a70-1c74-42ac-9334-dd959c1ea80f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ORInXmgN", "auth_password": "6jv4Rx9UDiX7bS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "d3d5ecec-19dc-4989-a561-09ad5028728b"}, "status": "reserved", "instance": "5be536dd-61f5-4a17-a734-029b25739a47", "attached_at": "", "detached_at": "", "volume_id": "d3d5ecec-19dc-4989-a561-09ad5028728b", "serial": "d3d5ecec-19dc-4989-a561-09ad5028728b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b', 'no_device': None, 'attachment_id': '8bd205d9-8868-460b-b031-38872b09a6ef'} {{(pid=82394) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.103s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-27eab0c4-101d-46a5-a472-d7de01ee4f14" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-27eab0c4-101d-46a5-a472-d7de01ee4f14" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Attempting to detach device tap27eab0c4-10 from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] detach device xml: <interface type="ethernet">
Apr 12 00:32:35 user nova-compute[82394]:   <mac address="fa:16:3e:9e:4f:fa"/>
Apr 12 00:32:35 user nova-compute[82394]:   <model type="virtio"/>
Apr 12 00:32:35 user nova-compute[82394]:   <mtu size="1442"/>
Apr 12 00:32:35 user nova-compute[82394]:   <target dev="tap27eab0c4-10"/>
Apr 12 00:32:35 user nova-compute[82394]: </interface>
Apr 12 00:32:35 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 00:32:35 user nova-compute[82394]:   <name>instance-00000007</name>
Apr 12 00:32:35 user nova-compute[82394]:   <uuid>f9dc12da-4db1-4305-93ea-2bd63870c097</uuid>
Apr 12 00:32:35 user nova-compute[82394]:   <metadata>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:35 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:24</nova:creationTime>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:35 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:35 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:35 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:port uuid="27eab0c4-101d-46a5-a472-d7de01ee4f14">
Apr 12 00:32:35 user nova-compute[82394]:       <nova:ip type="fixed" address="10.10.10.242" ipVersion="4"/>
Apr 12 00:32:35 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:35 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:35 user nova-compute[82394]:   </metadata>
Apr 12 00:32:35 user nova-compute[82394]:   <memory unit='KiB'>131072</memory>
Apr 12 00:32:35 user nova-compute[82394]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 00:32:35 user nova-compute[82394]:   <vcpu placement='static'>1</vcpu>
Apr 12 00:32:35 user nova-compute[82394]:   <resource>
Apr 12 00:32:35 user nova-compute[82394]:     <partition>/machine</partition>
Apr 12 00:32:35 user nova-compute[82394]:   </resource>
Apr 12 00:32:35 user nova-compute[82394]:   <sysinfo type='smbios'>
Apr 12 00:32:35 user nova-compute[82394]:     <system>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='version'>0.0.0</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='serial'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='uuid'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='family'>Virtual Machine</entry>
Apr 12 00:32:35 user nova-compute[82394]:     </system>
Apr 12 00:32:35 user nova-compute[82394]:   </sysinfo>
Apr 12 00:32:35 user nova-compute[82394]:   <os>
Apr 12 00:32:35 user nova-compute[82394]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 00:32:35 user nova-compute[82394]:     <boot dev='hd'/>
Apr 12 00:32:35 user nova-compute[82394]:     <smbios mode='sysinfo'/>
Apr 12 00:32:35 user nova-compute[82394]:   </os>
Apr 12 00:32:35 user nova-compute[82394]:   <features>
Apr 12 00:32:35 user nova-compute[82394]:     <acpi/>
Apr 12 00:32:35 user nova-compute[82394]:     <apic/>
Apr 12 00:32:35 user nova-compute[82394]:     <vmcoreinfo state='on'/>
Apr 12 00:32:35 user nova-compute[82394]:   </features>
Apr 12 00:32:35 user nova-compute[82394]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 00:32:35 user nova-compute[82394]:     <model fallback='forbid'>Nehalem</model>
Apr 12 00:32:35 user nova-compute[82394]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='vme'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='x2apic'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='hypervisor'/>
Apr 12 00:32:35 user nova-compute[82394]:   </cpu>
Apr 12 00:32:35 user nova-compute[82394]:   <clock offset='utc'>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='hpet' present='no'/>
Apr 12 00:32:35 user nova-compute[82394]:   </clock>
Apr 12 00:32:35 user nova-compute[82394]:   <on_poweroff>destroy</on_poweroff>
Apr 12 00:32:35 user nova-compute[82394]:   <on_reboot>restart</on_reboot>
Apr 12 00:32:35 user nova-compute[82394]:   <on_crash>destroy</on_crash>
Apr 12 00:32:35 user nova-compute[82394]:   <devices>
Apr 12 00:32:35 user nova-compute[82394]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 00:32:35 user nova-compute[82394]:     <disk type='file' device='disk'>
Apr 12 00:32:35 user nova-compute[82394]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 00:32:35 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk' index='2'/>
Apr 12 00:32:35 user nova-compute[82394]:       <backingStore type='file' index='3'>
Apr 12 00:32:35 user nova-compute[82394]:         <format type='raw'/>
Apr 12 00:32:35 user nova-compute[82394]:         <source file='/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997'/>
Apr 12 00:32:35 user nova-compute[82394]:         <backingStore/>
Apr 12 00:32:35 user nova-compute[82394]:       </backingStore>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='vda' bus='virtio'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='virtio-disk0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </disk>
Apr 12 00:32:35 user nova-compute[82394]:     <disk type='file' device='cdrom'>
Apr 12 00:32:35 user nova-compute[82394]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 00:32:35 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config' index='1'/>
Apr 12 00:32:35 user nova-compute[82394]:       <backingStore/>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='hda' bus='ide'/>
Apr 12 00:32:35 user nova-compute[82394]:       <readonly/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='ide0-0-0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </disk>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='usb' index='0' model='none'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='usb'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='pci.0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='ide' index='0'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='ide'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <interface type='ethernet'>
Apr 12 00:32:35 user nova-compute[82394]:       <mac address='fa:16:3e:89:48:de'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='tap47b92afd-7a'/>
Apr 12 00:32:35 user nova-compute[82394]:       <model type='virtio'/>
Apr 12 00:32:35 user nova-compute[82394]:       <mtu size='1442'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='net0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </interface>
Apr 12 00:32:35 user nova-compute[82394]:     <interface type='ethernet'>
Apr 12 00:32:35 user nova-compute[82394]:       <mac address='fa:16:3e:9e:4f:fa'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='tap27eab0c4-10'/>
Apr 12 00:32:35 user nova-compute[82394]:       <model type='virtio'/>
Apr 12 00:32:35 user nova-compute[82394]:       <mtu size='1442'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='net1'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </interface>
Apr 12 00:32:35 user nova-compute[82394]:     <serial type='pty'>
Apr 12 00:32:35 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:35 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target type='isa-serial' port='0'>
Apr 12 00:32:35 user nova-compute[82394]:         <model name='isa-serial'/>
Apr 12 00:32:35 user nova-compute[82394]:       </target>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </serial>
Apr 12 00:32:35 user nova-compute[82394]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 00:32:35 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:35 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target type='serial' port='0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </console>
Apr 12 00:32:35 user nova-compute[82394]:     <input type='mouse' bus='ps2'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='input0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </input>
Apr 12 00:32:35 user nova-compute[82394]:     <input type='keyboard' bus='ps2'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='input1'/>
Apr 12 00:32:35 user nova-compute[82394]:     </input>
Apr 12 00:32:35 user nova-compute[82394]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 00:32:35 user nova-compute[82394]:       <listen type='address' address='0.0.0.0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </graphics>
Apr 12 00:32:35 user nova-compute[82394]:     <audio id='1' type='none'/>
Apr 12 00:32:35 user nova-compute[82394]:     <video>
Apr 12 00:32:35 user nova-compute[82394]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='video0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </video>
Apr 12 00:32:35 user nova-compute[82394]:     <memballoon model='virtio'>
Apr 12 00:32:35 user nova-compute[82394]:       <stats period='10'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='balloon0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </memballoon>
Apr 12 00:32:35 user nova-compute[82394]:     <rng model='virtio'>
Apr 12 00:32:35 user nova-compute[82394]:       <backend model='random'>/dev/urandom</backend>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='rng0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </rng>
Apr 12 00:32:35 user nova-compute[82394]:   </devices>
Apr 12 00:32:35 user nova-compute[82394]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 00:32:35 user nova-compute[82394]:     <label>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</label>
Apr 12 00:32:35 user nova-compute[82394]:     <imagelabel>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</imagelabel>
Apr 12 00:32:35 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:35 user nova-compute[82394]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 00:32:35 user nova-compute[82394]:     <label>+64055:+108</label>
Apr 12 00:32:35 user nova-compute[82394]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 00:32:35 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:35 user nova-compute[82394]: </domain>
Apr 12 00:32:35 user nova-compute[82394]:  {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 00:32:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully detached device tap27eab0c4-10 from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the persistent domain config.
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] (1/8): Attempting to detach device tap27eab0c4-10 with device alias net1 from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] detach device xml: <interface type="ethernet">
Apr 12 00:32:35 user nova-compute[82394]:   <mac address="fa:16:3e:9e:4f:fa"/>
Apr 12 00:32:35 user nova-compute[82394]:   <model type="virtio"/>
Apr 12 00:32:35 user nova-compute[82394]:   <mtu size="1442"/>
Apr 12 00:32:35 user nova-compute[82394]:   <target dev="tap27eab0c4-10"/>
Apr 12 00:32:35 user nova-compute[82394]: </interface>
Apr 12 00:32:35 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259555.9176533, f9dc12da-4db1-4305-93ea-2bd63870c097 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Start waiting for the detach event from libvirt for device tap27eab0c4-10 with device alias net1 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 00:32:35 user nova-compute[82394]:   <name>instance-00000007</name>
Apr 12 00:32:35 user nova-compute[82394]:   <uuid>f9dc12da-4db1-4305-93ea-2bd63870c097</uuid>
Apr 12 00:32:35 user nova-compute[82394]:   <metadata>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:35 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:24</nova:creationTime>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:35 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:35 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:35 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:port uuid="27eab0c4-101d-46a5-a472-d7de01ee4f14">
Apr 12 00:32:35 user nova-compute[82394]:       <nova:ip type="fixed" address="10.10.10.242" ipVersion="4"/>
Apr 12 00:32:35 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:35 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:35 user nova-compute[82394]:   </metadata>
Apr 12 00:32:35 user nova-compute[82394]:   <memory unit='KiB'>131072</memory>
Apr 12 00:32:35 user nova-compute[82394]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 00:32:35 user nova-compute[82394]:   <vcpu placement='static'>1</vcpu>
Apr 12 00:32:35 user nova-compute[82394]:   <resource>
Apr 12 00:32:35 user nova-compute[82394]:     <partition>/machine</partition>
Apr 12 00:32:35 user nova-compute[82394]:   </resource>
Apr 12 00:32:35 user nova-compute[82394]:   <sysinfo type='smbios'>
Apr 12 00:32:35 user nova-compute[82394]:     <system>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='version'>0.0.0</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='serial'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='uuid'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:35 user nova-compute[82394]:       <entry name='family'>Virtual Machine</entry>
Apr 12 00:32:35 user nova-compute[82394]:     </system>
Apr 12 00:32:35 user nova-compute[82394]:   </sysinfo>
Apr 12 00:32:35 user nova-compute[82394]:   <os>
Apr 12 00:32:35 user nova-compute[82394]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 00:32:35 user nova-compute[82394]:     <boot dev='hd'/>
Apr 12 00:32:35 user nova-compute[82394]:     <smbios mode='sysinfo'/>
Apr 12 00:32:35 user nova-compute[82394]:   </os>
Apr 12 00:32:35 user nova-compute[82394]:   <features>
Apr 12 00:32:35 user nova-compute[82394]:     <acpi/>
Apr 12 00:32:35 user nova-compute[82394]:     <apic/>
Apr 12 00:32:35 user nova-compute[82394]:     <vmcoreinfo state='on'/>
Apr 12 00:32:35 user nova-compute[82394]:   </features>
Apr 12 00:32:35 user nova-compute[82394]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 00:32:35 user nova-compute[82394]:     <model fallback='forbid'>Nehalem</model>
Apr 12 00:32:35 user nova-compute[82394]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='vme'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='x2apic'/>
Apr 12 00:32:35 user nova-compute[82394]:     <feature policy='require' name='hypervisor'/>
Apr 12 00:32:35 user nova-compute[82394]:   </cpu>
Apr 12 00:32:35 user nova-compute[82394]:   <clock offset='utc'>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 00:32:35 user nova-compute[82394]:     <timer name='hpet' present='no'/>
Apr 12 00:32:35 user nova-compute[82394]:   </clock>
Apr 12 00:32:35 user nova-compute[82394]:   <on_poweroff>destroy</on_poweroff>
Apr 12 00:32:35 user nova-compute[82394]:   <on_reboot>restart</on_reboot>
Apr 12 00:32:35 user nova-compute[82394]:   <on_crash>destroy</on_crash>
Apr 12 00:32:35 user nova-compute[82394]:   <devices>
Apr 12 00:32:35 user nova-compute[82394]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 00:32:35 user nova-compute[82394]:     <disk type='file' device='disk'>
Apr 12 00:32:35 user nova-compute[82394]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 00:32:35 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk' index='2'/>
Apr 12 00:32:35 user nova-compute[82394]:       <backingStore type='file' index='3'>
Apr 12 00:32:35 user nova-compute[82394]:         <format type='raw'/>
Apr 12 00:32:35 user nova-compute[82394]:         <source file='/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997'/>
Apr 12 00:32:35 user nova-compute[82394]:         <backingStore/>
Apr 12 00:32:35 user nova-compute[82394]:       </backingStore>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='vda' bus='virtio'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='virtio-disk0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </disk>
Apr 12 00:32:35 user nova-compute[82394]:     <disk type='file' device='cdrom'>
Apr 12 00:32:35 user nova-compute[82394]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 00:32:35 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config' index='1'/>
Apr 12 00:32:35 user nova-compute[82394]:       <backingStore/>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='hda' bus='ide'/>
Apr 12 00:32:35 user nova-compute[82394]:       <readonly/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='ide0-0-0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </disk>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='usb' index='0' model='none'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='usb'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='pci.0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <controller type='ide' index='0'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='ide'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 00:32:35 user nova-compute[82394]:     </controller>
Apr 12 00:32:35 user nova-compute[82394]:     <interface type='ethernet'>
Apr 12 00:32:35 user nova-compute[82394]:       <mac address='fa:16:3e:89:48:de'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target dev='tap47b92afd-7a'/>
Apr 12 00:32:35 user nova-compute[82394]:       <model type='virtio'/>
Apr 12 00:32:35 user nova-compute[82394]:       <mtu size='1442'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='net0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </interface>
Apr 12 00:32:35 user nova-compute[82394]:     <serial type='pty'>
Apr 12 00:32:35 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:35 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target type='isa-serial' port='0'>
Apr 12 00:32:35 user nova-compute[82394]:         <model name='isa-serial'/>
Apr 12 00:32:35 user nova-compute[82394]:       </target>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </serial>
Apr 12 00:32:35 user nova-compute[82394]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 00:32:35 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:35 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:35 user nova-compute[82394]:       <target type='serial' port='0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </console>
Apr 12 00:32:35 user nova-compute[82394]:     <input type='mouse' bus='ps2'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='input0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </input>
Apr 12 00:32:35 user nova-compute[82394]:     <input type='keyboard' bus='ps2'>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='input1'/>
Apr 12 00:32:35 user nova-compute[82394]:     </input>
Apr 12 00:32:35 user nova-compute[82394]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 00:32:35 user nova-compute[82394]:       <listen type='address' address='0.0.0.0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </graphics>
Apr 12 00:32:35 user nova-compute[82394]:     <audio id='1' type='none'/>
Apr 12 00:32:35 user nova-compute[82394]:     <video>
Apr 12 00:32:35 user nova-compute[82394]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='video0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </video>
Apr 12 00:32:35 user nova-compute[82394]:     <memballoon model='virtio'>
Apr 12 00:32:35 user nova-compute[82394]:       <stats period='10'/>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='balloon0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </memballoon>
Apr 12 00:32:35 user nova-compute[82394]:     <rng model='virtio'>
Apr 12 00:32:35 user nova-compute[82394]:       <backend model='random'>/dev/urandom</backend>
Apr 12 00:32:35 user nova-compute[82394]:       <alias name='rng0'/>
Apr 12 00:32:35 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 00:32:35 user nova-compute[82394]:     </rng>
Apr 12 00:32:35 user nova-compute[82394]:   </devices>
Apr 12 00:32:35 user nova-compute[82394]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 00:32:35 user nova-compute[82394]:     <label>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</label>
Apr 12 00:32:35 user nova-compute[82394]:     <imagelabel>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</imagelabel>
Apr 12 00:32:35 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:35 user nova-compute[82394]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 00:32:35 user nova-compute[82394]:     <label>+64055:+108</label>
Apr 12 00:32:35 user nova-compute[82394]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 00:32:35 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:35 user nova-compute[82394]: </domain>
Apr 12 00:32:35 user nova-compute[82394]:  {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 00:32:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully detached device tap27eab0c4-10 from instance f9dc12da-4db1-4305-93ea-2bd63870c097 from the live domain config.
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG os_vif [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27eab0c4-10, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:35 user nova-compute[82394]: INFO os_vif [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10')
Apr 12 00:32:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:35 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:35</nova:creationTime>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:35 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:35 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:35 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:35 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:35 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:35 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:35 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:35 user nova-compute[82394]:  {{(pid=82394) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-unplugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-unplugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:36 user nova-compute[82394]: WARNING nova.compute.manager [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-unplugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance with vm_state active and task_state None.
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-deleted-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:36 user nova-compute[82394]: INFO nova.compute.manager [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Neutron deleted interface 27eab0c4-101d-46a5-a472-d7de01ee4f14; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.neutron [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquired lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.neutron [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.objects.instance [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Lazy-loading 'system_metadata' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.objects.instance [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Lazy-loading 'flavor' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 00:32:36 user nova-compute[82394]:   <name>instance-00000007</name>
Apr 12 00:32:36 user nova-compute[82394]:   <uuid>f9dc12da-4db1-4305-93ea-2bd63870c097</uuid>
Apr 12 00:32:36 user nova-compute[82394]:   <metadata>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:36 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:35</nova:creationTime>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:36 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:36 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:36 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:36 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:36 user nova-compute[82394]:   </metadata>
Apr 12 00:32:36 user nova-compute[82394]:   <memory unit='KiB'>131072</memory>
Apr 12 00:32:36 user nova-compute[82394]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 00:32:36 user nova-compute[82394]:   <vcpu placement='static'>1</vcpu>
Apr 12 00:32:36 user nova-compute[82394]:   <resource>
Apr 12 00:32:36 user nova-compute[82394]:     <partition>/machine</partition>
Apr 12 00:32:36 user nova-compute[82394]:   </resource>
Apr 12 00:32:36 user nova-compute[82394]:   <sysinfo type='smbios'>
Apr 12 00:32:36 user nova-compute[82394]:     <system>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='version'>0.0.0</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='serial'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='uuid'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='family'>Virtual Machine</entry>
Apr 12 00:32:36 user nova-compute[82394]:     </system>
Apr 12 00:32:36 user nova-compute[82394]:   </sysinfo>
Apr 12 00:32:36 user nova-compute[82394]:   <os>
Apr 12 00:32:36 user nova-compute[82394]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 00:32:36 user nova-compute[82394]:     <boot dev='hd'/>
Apr 12 00:32:36 user nova-compute[82394]:     <smbios mode='sysinfo'/>
Apr 12 00:32:36 user nova-compute[82394]:   </os>
Apr 12 00:32:36 user nova-compute[82394]:   <features>
Apr 12 00:32:36 user nova-compute[82394]:     <acpi/>
Apr 12 00:32:36 user nova-compute[82394]:     <apic/>
Apr 12 00:32:36 user nova-compute[82394]:     <vmcoreinfo state='on'/>
Apr 12 00:32:36 user nova-compute[82394]:   </features>
Apr 12 00:32:36 user nova-compute[82394]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 00:32:36 user nova-compute[82394]:     <model fallback='forbid'>Nehalem</model>
Apr 12 00:32:36 user nova-compute[82394]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='vme'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='x2apic'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='hypervisor'/>
Apr 12 00:32:36 user nova-compute[82394]:   </cpu>
Apr 12 00:32:36 user nova-compute[82394]:   <clock offset='utc'>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='hpet' present='no'/>
Apr 12 00:32:36 user nova-compute[82394]:   </clock>
Apr 12 00:32:36 user nova-compute[82394]:   <on_poweroff>destroy</on_poweroff>
Apr 12 00:32:36 user nova-compute[82394]:   <on_reboot>restart</on_reboot>
Apr 12 00:32:36 user nova-compute[82394]:   <on_crash>destroy</on_crash>
Apr 12 00:32:36 user nova-compute[82394]:   <devices>
Apr 12 00:32:36 user nova-compute[82394]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 00:32:36 user nova-compute[82394]:     <disk type='file' device='disk'>
Apr 12 00:32:36 user nova-compute[82394]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 00:32:36 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk' index='2'/>
Apr 12 00:32:36 user nova-compute[82394]:       <backingStore type='file' index='3'>
Apr 12 00:32:36 user nova-compute[82394]:         <format type='raw'/>
Apr 12 00:32:36 user nova-compute[82394]:         <source file='/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997'/>
Apr 12 00:32:36 user nova-compute[82394]:         <backingStore/>
Apr 12 00:32:36 user nova-compute[82394]:       </backingStore>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='vda' bus='virtio'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='virtio-disk0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </disk>
Apr 12 00:32:36 user nova-compute[82394]:     <disk type='file' device='cdrom'>
Apr 12 00:32:36 user nova-compute[82394]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 00:32:36 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config' index='1'/>
Apr 12 00:32:36 user nova-compute[82394]:       <backingStore/>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='hda' bus='ide'/>
Apr 12 00:32:36 user nova-compute[82394]:       <readonly/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='ide0-0-0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </disk>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='usb' index='0' model='none'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='usb'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='pci.0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='ide' index='0'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='ide'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <interface type='ethernet'>
Apr 12 00:32:36 user nova-compute[82394]:       <mac address='fa:16:3e:89:48:de'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='tap47b92afd-7a'/>
Apr 12 00:32:36 user nova-compute[82394]:       <model type='virtio'/>
Apr 12 00:32:36 user nova-compute[82394]:       <mtu size='1442'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='net0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </interface>
Apr 12 00:32:36 user nova-compute[82394]:     <serial type='pty'>
Apr 12 00:32:36 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:36 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target type='isa-serial' port='0'>
Apr 12 00:32:36 user nova-compute[82394]:         <model name='isa-serial'/>
Apr 12 00:32:36 user nova-compute[82394]:       </target>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </serial>
Apr 12 00:32:36 user nova-compute[82394]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 00:32:36 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:36 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target type='serial' port='0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </console>
Apr 12 00:32:36 user nova-compute[82394]:     <input type='mouse' bus='ps2'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='input0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </input>
Apr 12 00:32:36 user nova-compute[82394]:     <input type='keyboard' bus='ps2'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='input1'/>
Apr 12 00:32:36 user nova-compute[82394]:     </input>
Apr 12 00:32:36 user nova-compute[82394]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 00:32:36 user nova-compute[82394]:       <listen type='address' address='0.0.0.0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </graphics>
Apr 12 00:32:36 user nova-compute[82394]:     <audio id='1' type='none'/>
Apr 12 00:32:36 user nova-compute[82394]:     <video>
Apr 12 00:32:36 user nova-compute[82394]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='video0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </video>
Apr 12 00:32:36 user nova-compute[82394]:     <memballoon model='virtio'>
Apr 12 00:32:36 user nova-compute[82394]:       <stats period='10'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='balloon0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </memballoon>
Apr 12 00:32:36 user nova-compute[82394]:     <rng model='virtio'>
Apr 12 00:32:36 user nova-compute[82394]:       <backend model='random'>/dev/urandom</backend>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='rng0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </rng>
Apr 12 00:32:36 user nova-compute[82394]:   </devices>
Apr 12 00:32:36 user nova-compute[82394]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 00:32:36 user nova-compute[82394]:     <label>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</label>
Apr 12 00:32:36 user nova-compute[82394]:     <imagelabel>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</imagelabel>
Apr 12 00:32:36 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:36 user nova-compute[82394]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 00:32:36 user nova-compute[82394]:     <label>+64055:+108</label>
Apr 12 00:32:36 user nova-compute[82394]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 00:32:36 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:36 user nova-compute[82394]: </domain>
Apr 12 00:32:36 user nova-compute[82394]:  {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface> {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:4f:fa"/><model type="virtio"/><mtu size="1442"/><target dev="tap27eab0c4-10"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 00:32:36 user nova-compute[82394]:   <name>instance-00000007</name>
Apr 12 00:32:36 user nova-compute[82394]:   <uuid>f9dc12da-4db1-4305-93ea-2bd63870c097</uuid>
Apr 12 00:32:36 user nova-compute[82394]:   <metadata>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:36 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:35</nova:creationTime>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:36 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:36 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:36 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:36 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:36 user nova-compute[82394]:   </metadata>
Apr 12 00:32:36 user nova-compute[82394]:   <memory unit='KiB'>131072</memory>
Apr 12 00:32:36 user nova-compute[82394]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 00:32:36 user nova-compute[82394]:   <vcpu placement='static'>1</vcpu>
Apr 12 00:32:36 user nova-compute[82394]:   <resource>
Apr 12 00:32:36 user nova-compute[82394]:     <partition>/machine</partition>
Apr 12 00:32:36 user nova-compute[82394]:   </resource>
Apr 12 00:32:36 user nova-compute[82394]:   <sysinfo type='smbios'>
Apr 12 00:32:36 user nova-compute[82394]:     <system>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='version'>0.0.0</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='serial'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='uuid'>f9dc12da-4db1-4305-93ea-2bd63870c097</entry>
Apr 12 00:32:36 user nova-compute[82394]:       <entry name='family'>Virtual Machine</entry>
Apr 12 00:32:36 user nova-compute[82394]:     </system>
Apr 12 00:32:36 user nova-compute[82394]:   </sysinfo>
Apr 12 00:32:36 user nova-compute[82394]:   <os>
Apr 12 00:32:36 user nova-compute[82394]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 00:32:36 user nova-compute[82394]:     <boot dev='hd'/>
Apr 12 00:32:36 user nova-compute[82394]:     <smbios mode='sysinfo'/>
Apr 12 00:32:36 user nova-compute[82394]:   </os>
Apr 12 00:32:36 user nova-compute[82394]:   <features>
Apr 12 00:32:36 user nova-compute[82394]:     <acpi/>
Apr 12 00:32:36 user nova-compute[82394]:     <apic/>
Apr 12 00:32:36 user nova-compute[82394]:     <vmcoreinfo state='on'/>
Apr 12 00:32:36 user nova-compute[82394]:   </features>
Apr 12 00:32:36 user nova-compute[82394]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 00:32:36 user nova-compute[82394]:     <model fallback='forbid'>Nehalem</model>
Apr 12 00:32:36 user nova-compute[82394]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='vme'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='x2apic'/>
Apr 12 00:32:36 user nova-compute[82394]:     <feature policy='require' name='hypervisor'/>
Apr 12 00:32:36 user nova-compute[82394]:   </cpu>
Apr 12 00:32:36 user nova-compute[82394]:   <clock offset='utc'>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 00:32:36 user nova-compute[82394]:     <timer name='hpet' present='no'/>
Apr 12 00:32:36 user nova-compute[82394]:   </clock>
Apr 12 00:32:36 user nova-compute[82394]:   <on_poweroff>destroy</on_poweroff>
Apr 12 00:32:36 user nova-compute[82394]:   <on_reboot>restart</on_reboot>
Apr 12 00:32:36 user nova-compute[82394]:   <on_crash>destroy</on_crash>
Apr 12 00:32:36 user nova-compute[82394]:   <devices>
Apr 12 00:32:36 user nova-compute[82394]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 00:32:36 user nova-compute[82394]:     <disk type='file' device='disk'>
Apr 12 00:32:36 user nova-compute[82394]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 00:32:36 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk' index='2'/>
Apr 12 00:32:36 user nova-compute[82394]:       <backingStore type='file' index='3'>
Apr 12 00:32:36 user nova-compute[82394]:         <format type='raw'/>
Apr 12 00:32:36 user nova-compute[82394]:         <source file='/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997'/>
Apr 12 00:32:36 user nova-compute[82394]:         <backingStore/>
Apr 12 00:32:36 user nova-compute[82394]:       </backingStore>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='vda' bus='virtio'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='virtio-disk0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </disk>
Apr 12 00:32:36 user nova-compute[82394]:     <disk type='file' device='cdrom'>
Apr 12 00:32:36 user nova-compute[82394]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 00:32:36 user nova-compute[82394]:       <source file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk.config' index='1'/>
Apr 12 00:32:36 user nova-compute[82394]:       <backingStore/>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='hda' bus='ide'/>
Apr 12 00:32:36 user nova-compute[82394]:       <readonly/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='ide0-0-0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </disk>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='usb' index='0' model='none'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='usb'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='pci.0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <controller type='ide' index='0'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='ide'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 00:32:36 user nova-compute[82394]:     </controller>
Apr 12 00:32:36 user nova-compute[82394]:     <interface type='ethernet'>
Apr 12 00:32:36 user nova-compute[82394]:       <mac address='fa:16:3e:89:48:de'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target dev='tap47b92afd-7a'/>
Apr 12 00:32:36 user nova-compute[82394]:       <model type='virtio'/>
Apr 12 00:32:36 user nova-compute[82394]:       <mtu size='1442'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='net0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </interface>
Apr 12 00:32:36 user nova-compute[82394]:     <serial type='pty'>
Apr 12 00:32:36 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:36 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target type='isa-serial' port='0'>
Apr 12 00:32:36 user nova-compute[82394]:         <model name='isa-serial'/>
Apr 12 00:32:36 user nova-compute[82394]:       </target>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </serial>
Apr 12 00:32:36 user nova-compute[82394]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 00:32:36 user nova-compute[82394]:       <source path='/dev/pts/6'/>
Apr 12 00:32:36 user nova-compute[82394]:       <log file='/opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/console.log' append='off'/>
Apr 12 00:32:36 user nova-compute[82394]:       <target type='serial' port='0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='serial0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </console>
Apr 12 00:32:36 user nova-compute[82394]:     <input type='mouse' bus='ps2'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='input0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </input>
Apr 12 00:32:36 user nova-compute[82394]:     <input type='keyboard' bus='ps2'>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='input1'/>
Apr 12 00:32:36 user nova-compute[82394]:     </input>
Apr 12 00:32:36 user nova-compute[82394]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 00:32:36 user nova-compute[82394]:       <listen type='address' address='0.0.0.0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </graphics>
Apr 12 00:32:36 user nova-compute[82394]:     <audio id='1' type='none'/>
Apr 12 00:32:36 user nova-compute[82394]:     <video>
Apr 12 00:32:36 user nova-compute[82394]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='video0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </video>
Apr 12 00:32:36 user nova-compute[82394]:     <memballoon model='virtio'>
Apr 12 00:32:36 user nova-compute[82394]:       <stats period='10'/>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='balloon0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </memballoon>
Apr 12 00:32:36 user nova-compute[82394]:     <rng model='virtio'>
Apr 12 00:32:36 user nova-compute[82394]:       <backend model='random'>/dev/urandom</backend>
Apr 12 00:32:36 user nova-compute[82394]:       <alias name='rng0'/>
Apr 12 00:32:36 user nova-compute[82394]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 00:32:36 user nova-compute[82394]:     </rng>
Apr 12 00:32:36 user nova-compute[82394]:   </devices>
Apr 12 00:32:36 user nova-compute[82394]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 00:32:36 user nova-compute[82394]:     <label>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</label>
Apr 12 00:32:36 user nova-compute[82394]:     <imagelabel>libvirt-f9dc12da-4db1-4305-93ea-2bd63870c097</imagelabel>
Apr 12 00:32:36 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:36 user nova-compute[82394]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 00:32:36 user nova-compute[82394]:     <label>+64055:+108</label>
Apr 12 00:32:36 user nova-compute[82394]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 00:32:36 user nova-compute[82394]:   </seclabel>
Apr 12 00:32:36 user nova-compute[82394]: </domain>
Apr 12 00:32:36 user nova-compute[82394]:  {{(pid=82394) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 00:32:36 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Detaching interface fa:16:3e:9e:4f:fa failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap27eab0c4-10' not found.
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Converting VIF {"id": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "address": "fa:16:3e:9e:4f:fa", "network": {"id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1734723698", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eab0c4-10", "ovs_interfaceid": "27eab0c4-101d-46a5-a472-d7de01ee4f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_vif [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27eab0c4-10, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:32:36 user nova-compute[82394]: INFO os_vif [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4f:fa,bridge_name='br-int',has_traffic_filtering=True,id=27eab0c4-101d-46a5-a472-d7de01ee4f14,network=Network(df07df70-1ed7-4b48-9b14-5be5c30e51b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eab0c4-10')
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:32:36 user nova-compute[82394]:   <nova:package version="0.0.0"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:name>tempest-device-tagging-server-1251564681</nova:name>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:creationTime>2023-04-12 00:32:36</nova:creationTime>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:flavor name="m1.nano">
Apr 12 00:32:36 user nova-compute[82394]:     <nova:memory>128</nova:memory>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:disk>1</nova:disk>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:swap>0</nova:swap>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:vcpus>1</nova:vcpus>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:flavor>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:user uuid="3dae26de34e047b8b4fe08b2e56a4b62">tempest-TaggedAttachmentsTest-552970798-project-member</nova:user>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:project uuid="e7abb0634c7c44699a5197b9876b612c">tempest-TaggedAttachmentsTest-552970798</nova:project>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:owner>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:32:36 user nova-compute[82394]:   <nova:ports>
Apr 12 00:32:36 user nova-compute[82394]:     <nova:port uuid="47b92afd-7a5c-49a0-aea8-abccac5e350c">
Apr 12 00:32:36 user nova-compute[82394]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:32:36 user nova-compute[82394]:     </nova:port>
Apr 12 00:32:36 user nova-compute[82394]:   </nova:ports>
Apr 12 00:32:36 user nova-compute[82394]: </nova:instance>
Apr 12 00:32:36 user nova-compute[82394]:  {{(pid=82394) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.utils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8538be-4d17-407a-99dd-c640b7c8a683]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8dca46-1c36-4c4e-b871-d786fe681854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG nova.network.neutron [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [{"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9bec6-0130-49c4-8b80-7aba11a75dec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a79f82-4d74-4ffc-a480-c0b6213e386d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Releasing lock "refresh_cache-f9dc12da-4db1-4305-93ea-2bd63870c097" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:36 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a5c004-5a86-49e7-a1bd-87e531606aef]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:36 user nova-compute[82394]: DEBUG os_brick.utils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "interface-f9dc12da-4db1-4305-93ea-2bd63870c097-27eab0c4-101d-46a5-a472-d7de01ee4f14" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.430s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:37 user nova-compute[82394]: INFO nova.compute.manager [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Swapping volume d3d5ecec-19dc-4989-a561-09ad5028728b for 65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:38 user nova-compute[82394]: WARNING nova.compute.manager [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance with vm_state active and task_state None.
Apr 12 00:32:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': '65678a70-1c74-42ac-9334-dd959c1ea80f', 'serial': '65678a70-1c74-42ac-9334-dd959c1ea80f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b'}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b', 'serial'} {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:41 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:41 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:41 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f47207-9b11-4355-b508-116784e89b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:32:41 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[30147707-3497-4076-86ca-e523d398d333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f] added
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d4791-12a5-4586-9d3f-12369161e795]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f4d9c-29af-41cb-9eb0-6caf5a97cc26]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yklhTIte {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yklhTIte" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8bcd7-7d8a-4562-974f-bb7dfb85a01c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yklhTIte'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2402c3f-0378-425c-986a-850df05d5ebc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[689df2f8-9535-4acb-b5ca-1b52733e627b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38fe4e1-c995-445f-87c9-ac5f17cb31cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]
Apr 12 00:32:41 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ecf6c-7be6-4017-b163-eac7846084d5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b194c2d7-9211-4724-952d-22099b003ff2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:41 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02860c-a4f5-4b07-b95c-9689bf80d3f1]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:32:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23631353435633933', 'path': '/dev/sdj'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631353435633933', 'path': '/dev/sdj'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lazy-loading 'flavor' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-changed-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing instance network info cache due to event network-changed-ad31f866-7d58-49a8-9e24-17ec4ad04a48. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Acquiring lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Acquired lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Refreshing network info cache for port ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 153092096 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updated VIF entry in instance network info cache for port ad31f866-7d58-49a8-9e24-17ec4ad04a48. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Releasing lock "refresh_cache-e3b52368-86be-4211-a37b-522ed3991a00" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 484442112 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:44 user nova-compute[82394]: INFO nova.compute.manager [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Terminating instance
Apr 12 00:32:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-changed-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing instance network info cache due to event network-changed-09b82fec-ca71-4934-ac24-073ca9080c9c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Acquiring lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Acquired lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.network.neutron [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Refreshing network info cache for port 09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 760217600 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259550.817483, db3a1291-c686-4e29-8499-8d49dd74a7bb => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:32:45 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] VM Stopped (Lifecycle Event)
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1c02668e-48f8-40d2-b63b-9bcc0d02b7a3 None None] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-b9c15342-4557-47ce-a9ed-4c378fe66186 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:32:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Instance destroyed successfully.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.objects.instance [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lazy-loading 'resources' on Instance uuid e3b52368-86be-4211-a37b-522ed3991a00 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ORInXmgN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'd3d5ecec-19dc-4989-a561-09ad5028728b': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad31f866-7d, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e0be4-e69d-47b0-8577-80424d71bbbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]: iSNS:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]: STATIC:
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:47 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:47 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updated VIF entry in instance network info cache for port 09b82fec-ca71-4934-ac24-073ca9080c9c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5329aee-e1db-49ba-ba6e-4cde134140ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Releasing lock "refresh_cache-f784806a-987f-4861-a23a-dbf961c8b6c1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:a1:62,bridge_name='br-int',has_traffic_filtering=True,id=ad31f866-7d58-49a8-9e24-17ec4ad04a48,network=Network(f93a64f7-abf3-4107-9031-b3707a5ffdb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad31f866-7d')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02d77b15-fb, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d98440-8c3a-4d32-9215-01ef6768c4f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347ac8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b'): ({'sdk'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Removing single pathed devices sdk {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[399030dc-3524-425c-ac69-98706d0e78ab]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ad:4c,bridge_name='br-int',has_traffic_filtering=True,id=02d77b15-fb16-44e3-9c20-d319e7302449,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap02d77b15-fb')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3227d-4775-48e8-9328-361b62d09c8f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Flushing IO for device /dev/sdk {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6903c204-8c, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c066a10-f971-4ae3-a5a8-1f8a99df6f87]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:44,bridge_name='br-int',has_traffic_filtering=True,id=6903c204-8c47-4dbf-991d-28e91739df40,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6903c204-8c')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce436977-ccf2-45a1-87a0-5bf7d24a8dd1]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] SCSI volumes sdk have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9c15342-45, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4345e79-425a-4fce-8d1d-5e19c4bd8ea5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=b9c15342-4557-47ce-a9ed-4c378fe66186,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c15342-45')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "address": "fa:16:3e:b7:7e:c2", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb09d545e-e0", "ovs_interfaceid": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb09d545e-e0, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46,network=Network(77337857-32d2-403b-b63a-c3c2db169526),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb09d545e-e0')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34faa1f7-7c, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-6903c204-8c47-4dbf-991d-28e91739df40 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-6903c204-8c47-4dbf-991d-28e91739df40 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39351c2-d59b-4b65-9e42-1c26501f2a79]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260]
Apr 12 00:32:47 user nova-compute[82394]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=34faa1f7-7c0e-4272-a3b6-092979dd46b8,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34faa1f7-7c')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1572227016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1572227016',id=8,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g==',key_name='tempest-keypair-803644994',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c45d99a301794a748dadf4c96860835c',ramdisk_id='',reservation_id='r-ol02000y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2057856153',owner_user_name='tempest-TaggedBootDevicesTest_v242-2057856153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='846fa2a73bbb4036ad3fb19afc811131',uuid=e3b52368-86be-4211-a37b-522ed3991a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converting VIF {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a80b7d7-aa, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:47 user nova-compute[82394]: INFO os_vif [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b6:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6,network=Network(461419cd-f897-4bc9-b9a4-d0a23f965f34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a80b7d7-aa')
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmVUIaSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d5ecec-19dc-4989-a561-09ad5028728b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0f4b8-39fc-45ee-9f45-f8b60b5efe89]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] <== disconnect_volume: return (482ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.059s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a99a6cd-3358-4b2a-9e24-ab25d147a10b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]: iSNS:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]: STATIC:
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:47 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:47 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:47 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:47 user nova-compute[82394]: No targets found.
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:47 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:47 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-02d77b15-fb16-44e3-9c20-d319e7302449 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-02d77b15-fb16-44e3-9c20-d319e7302449 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '5be536dd-61f5-4a17-a734-029b25739a47', 'attached_at': '', 'detached_at': '', 'volume_id': '65678a70-1c74-42ac-9334-dd959c1ea80f', 'serial'} {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: removing Cinder connection for volume d3d5ecec-19dc-4989-a561-09ad5028728b {{(pid=82394) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5c0b3-14e8-47e1-866c-cab013b62c05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf7cab6-7126-4747-9670-62595626f585]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:47 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:47 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343cf0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18'): ({'sde'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Removing single pathed devices sde {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc75f8f-06c1-482c-84d2-a223f87cf519]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b28814-b2ac-4849-b222-ad6027b05d89]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flushing IO for device /dev/sde {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a951b4-618f-4650-b4a9-15ea55926df9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b713819-a7d8-4aa5-b376-6daf45e18083]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea55f2d-79af-4263-b373-deefccc52269]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b9c15342-4557-47ce-a9ed-4c378fe66186 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-unplugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-unplugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Acquiring lock "e3b52368-86be-4211-a37b-522ed3991a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "e3b52368-86be-4211-a37b-522ed3991a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] No waiting events found dispatching network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:47 user nova-compute[82394]: WARNING nova.compute.manager [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received unexpected event network-vif-plugged-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance with vm_state active and task_state deleting.
Apr 12 00:32:47 user nova-compute[82394]: INFO nova.compute.manager [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Terminating instance
Apr 12 00:32:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[673634df-191d-483d-bc38-2291475c01ca]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260]
Apr 12 00:32:48 user nova-compute[82394]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d78963-38c7-4866-9bf0-26eafb026b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[99902d20-2d3d-4e14-9514-aec73b0fea04]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== disconnect_volume: return (547ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upVNxArC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:48 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159c4c5-64db-49dc-bd78-1e10903db326]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]: iSNS:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]: STATIC:
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:48 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:48 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805bc12-0319-4b16-adfa-8af3a2e7783f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15bb01-3c33-48a6-aaa7-5c514b0ea24c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343cf640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af1ce7-6f50-4d7f-8e47-29f882fe2243]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4255209-2207-4d92-9816-d8847ecfe326]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a8a9c-6d91-4943-98ba-4ccf39d6eb0f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4f7dc-0c93-44b7-b266-d7764894adea]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[21739c37-ac52-43ab-9c43-1fe32495e51b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.129s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af574e-1738-4650-b5f0-61f933509949]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260]
Apr 12 00:32:48 user nova-compute[82394]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68781ad8-f1c7-4aa8-8698-e079ecdea5a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa29bd0-43c3-4639-8968-2aa3ed791ca6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.548s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== disconnect_volume: return (551ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcgLFWam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:48 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[17619439-f3ee-4e27-ac51-280c9b4c3abc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]: iSNS:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]: STATIC:
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:48 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:48 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:48 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:48 user nova-compute[82394]: No targets found.
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:48 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:48 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2345ade-4e9c-40a3-9b6d-678db2ea3d6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe6a0d6-5351-48d3-bb99-235d7696aa74]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] swap_volume: Updating volume d3d5ecec-19dc-4989-a561-09ad5028728b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yklhTIte", "auth_password": "pbnKZJe3ykhuTc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "65678a70-1c74-42ac-9334-dd959c1ea80f"}, "status": "reserved", "instance": "5be536dd-61f5-4a17-a734-029b25739a47", "attached_at": "", "detached_at": "", "volume_id": "65678a70-1c74-42ac-9334-dd959c1ea80f", "serial": "65678a70-1c74-42ac-9334-dd959c1ea80f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '65678a70-1c74-42ac-9334-dd959c1ea80f', 'no_device': None, 'attachment_id': '827073b1-f2ed-416c-9615-189bfc6eed5e'} {{(pid=82394) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:48 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:48 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2344605e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652'): ({'sdc'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Removing single pathed devices sdc {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.009s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7173e-abd1-4d27-b059-77a5e75aa82f]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f75556-055e-4b35-adf6-beb55853b698]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flushing IO for device /dev/sdc {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b807725-dc14-4a62-baf1-6c7a6d5867d0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8bea68-7441-44c0-acc8-e1eaf5f6793b]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.107s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38954b-18dc-4b5a-9d2f-3e48b7e72346]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --logout" returned: 0 in 0.127s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a78da-4db4-428a-a66b-f5e6ce500a3f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260]
Apr 12 00:32:49 user nova-compute[82394]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b952b7bd-63f1-4f96-be7e-f66be254c652 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea30483-ad7b-45ce-aa28-61aa3f5c3b16]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.626s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] <== disconnect_volume: return (629ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Deleting instance files /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00_del
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Deletion of /opt/stack/data/nova/instances/e3b52368-86be-4211-a37b-522ed3991a00_del complete
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.014s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.compute.manager [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Terminating instance
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.compute.manager [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Took 4.55 seconds to destroy the instance on the hypervisor.
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.compute.manager [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Detaching volume 65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.virt.block_device [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Attempting to driver detach volume 65678a70-1c74-42ac-9334-dd959c1ea80f from mountpoint /dev/vdb
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-09b82fec-ca71-4934-ac24-073ca9080c9c for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: WARNING nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-09b82fec-ca71-4934-ac24-073ca9080c9c for instance with vm_state active and task_state deleting.
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: WARNING nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance with vm_state active and task_state deleting.
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:49 user nova-compute[82394]: WARNING nova.compute.manager [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance with vm_state active and task_state deleting.
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Attempting to detach device vdb from instance 5be536dd-61f5-4a17-a734-029b25739a47 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:49 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:49 user nova-compute[82394]:   <source dev="/dev/sdj"/>
Apr 12 00:32:49 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:49 user nova-compute[82394]:   <serial>65678a70-1c74-42ac-9334-dd959c1ea80f</serial>
Apr 12 00:32:49 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:32:49 user nova-compute[82394]: </disk>
Apr 12 00:32:49 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Successfully detached device vdb from instance 5be536dd-61f5-4a17-a734-029b25739a47 from the persistent domain config.
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5be536dd-61f5-4a17-a734-029b25739a47 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:32:49 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:32:49 user nova-compute[82394]:   <source dev="/dev/sdj"/>
Apr 12 00:32:49 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:32:49 user nova-compute[82394]:   <serial>65678a70-1c74-42ac-9334-dd959c1ea80f</serial>
Apr 12 00:32:49 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:32:49 user nova-compute[82394]: </disk>
Apr 12 00:32:49 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:32:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:50 user nova-compute[82394]: WARNING nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance with vm_state active and task_state deleting.
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-f9be977e-033f-44cb-adda-1590a13ccbdb for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:50 user nova-compute[82394]: WARNING nova.compute.manager [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f9be977e-033f-44cb-adda-1590a13ccbdb for instance with vm_state active and task_state deleting.
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Instance destroyed successfully.
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lazy-loading 'resources' on Instance uuid f784806a-987f-4861-a23a-dbf961c8b6c1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Instance destroyed successfully.
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid 7f1f85bf-03e5-493e-b187-955998b020ee {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-839730056',display_name='tempest-TestVolumeBootPattern-server-839730056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-839730056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-jltfkn3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:16Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=7f1f85bf-03e5-493e-b187-955998b020ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "b987249f-523f-4356-bdc9-82518d86209b", "address": "fa:16:3e:c2:2b:c3", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987249f-52", "ovs_interfaceid": "b987249f-523f-4356-bdc9-82518d86209b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_vif [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259570.6147437, 5be536dd-61f5-4a17-a734-029b25739a47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb987249f-52, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:50 user nova-compute[82394]: INFO os_vif [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2b:c3,bridge_name='br-int',has_traffic_filtering=True,id=b987249f-523f-4356-bdc9-82518d86209b,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987249f-52')
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b82fec-ca, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Successfully detached device vdb from instance 5be536dd-61f5-4a17-a734-029b25739a47 from the live domain config.
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyvIYkhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yklhTIte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '65678a70-1c74-42ac-9334-dd959c1ea80f': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[824c3eb6-8c84-4935-99cb-6e3031ce1820]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:50 user nova-compute[82394]: No targets found.
Apr 12 00:32:50 user nova-compute[82394]: iSNS:
Apr 12 00:32:50 user nova-compute[82394]: No targets found.
Apr 12 00:32:50 user nova-compute[82394]: STATIC:
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:50 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:50 user nova-compute[82394]: No targets found.
Apr 12 00:32:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:50 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:50 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da69112-de85-462a-9b97-799b5c1071c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:98:aa,bridge_name='br-int',has_traffic_filtering=True,id=09b82fec-ca71-4934-ac24-073ca9080c9c,network=Network(e45ac6be-a614-418d-afda-8428738f541e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b82fec-ca')
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b6ea381-2a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d588bc8-4277-44b9-ac7c-9620f0cefbc0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:50 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243cbaa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:50 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=0b6ea381-2a40-4f39-a8a5-88a31565ea17,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0b6ea381-2a')
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d5703b7-ff, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861a2ac-e1ed-4278-a641-77ae84799e12]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f95e3-9294-482a-b5e8-3cf84c26dae3]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5184508-3fa3-441a-a87b-8caa6f2f1d04]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:51 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:72,bridge_name='br-int',has_traffic_filtering=True,id=8d5703b7-ffc6-4337-9cbe-98328e04c0eb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5703b7-ff')
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb8ab354-db, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Error from libvirt while getting description of instance-00000008: [Error Code 42] Domain not found: no domain with matching uuid 'e3b52368-86be-4211-a37b-522ed3991a00' (instance-00000008): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e3b52368-86be-4211-a37b-522ed3991a00' (instance-00000008)
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a9236-b972-4d11-93ab-d21b370ec7e6]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:51 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:32:c4,bridge_name='br-int',has_traffic_filtering=True,id=bb8ab354-dbbc-4141-9499-5689ae95fb2f,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb8ab354-db')
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f9be977e-033f-44cb-adda-1590a13ccbdb", "address": "fa:16:3e:7b:7b:73", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9be977e-03", "ovs_interfaceid": "f9be977e-033f-44cb-adda-1590a13ccbdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9be977e-03, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0325a3b-fec3-4e46-b45d-8347d5b6e33a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7b:73,bridge_name='br-int',has_traffic_filtering=True,id=f9be977e-033f-44cb-adda-1590a13ccbdb,network=Network(4434dbb7-595f-44b7-8e1b-d9197b4801f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9be977e-03')
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf528d725-8c, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f8:fe,bridge_name='br-int',has_traffic_filtering=True,id=f528d725-8cc8-49c2-8e45-56340893e4c7,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf528d725-8c')
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1045274061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1045274061',id=9,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ==',key_name='tempest-keypair-2004337280',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6b2a25677e14a23ae7b81e2e56c008a',ramdisk_id='',reservation_id='r-44fue1bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801742631',owner_user_name='tempest-TaggedBootDevicesTest-801742631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6b3a1f732c47e1aaa08b26056695d3',uuid=f784806a-987f-4861-a23a-dbf961c8b6c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converting VIF {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d9fcf83-a9, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7f948d-cd5c-41ed-ac15-f284424919bb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260]
Apr 12 00:32:51 user nova-compute[82394]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:32:51 user nova-compute[82394]: INFO os_vif [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b,network=Network(f9a3e3a0-6218-4c97-bde2-ecd1947cafd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9fcf83-a9')
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7181MB free_disk=26.543819427490234GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkRbQNEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f8f8733-e863-4c36-bdd5-bdc33446a551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c7788-f0d0-43a0-adfe-e0e4109c2c32]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.830s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (832ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Deleting instance files /opt/stack/data/nova/instances/7f1f85bf-03e5-493e-b187-955998b020ee_del
Apr 12 00:32:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Deletion of /opt/stack/data/nova/instances/7f1f85bf-03e5-493e-b187-955998b020ee_del complete
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.832s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e9a13-a995-4400-812c-119b170789b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:51 user nova-compute[82394]: No targets found.
Apr 12 00:32:51 user nova-compute[82394]: iSNS:
Apr 12 00:32:51 user nova-compute[82394]: No targets found.
Apr 12 00:32:51 user nova-compute[82394]: STATIC:
Apr 12 00:32:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f
Apr 12 00:32:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:51 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:51 user nova-compute[82394]: No targets found.
Apr 12 00:32:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:51 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:51 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00db162-fd4e-4f7f-9027-fd73e2c048f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b827a28-2564-42d3-8f8a-c79730ca6f27]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:51 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c33c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f'): ({'sdj'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Removing single pathed devices sdj {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: INFO nova.compute.manager [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Took 2.32 seconds to destroy the instance on the hypervisor.
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be833c9-4457-404a-8df2-260543467d51]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 570abef1-f803-4f3e-8051-b6f690063496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f784806a-987f-4861-a23a-dbf961c8b6c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 5be536dd-61f5-4a17-a734-029b25739a47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance e3b52368-86be-4211-a37b-522ed3991a00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 7f1f85bf-03e5-493e-b187-955998b020ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f9dc12da-4db1-4305-93ea-2bd63870c097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2c8ae-814a-4d55-a1df-d99627e42850]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Flushing IO for device /dev/sdj {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8816be-544f-40c7-a2a1-88a246846ae1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-f528d725-8cc8-49c2-8e45-56340893e4c7 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-f528d725-8cc8-49c2-8e45-56340893e4c7 for instance with vm_state active and task_state deleting.
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-unplugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-unplugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] No waiting events found dispatching network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received unexpected event network-vif-plugged-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance with vm_state active and task_state deleting.
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-unplugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] No waiting events found dispatching network-vif-unplugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-unplugged-b987249f-523f-4356-bdc9-82518d86209b for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "7f1f85bf-03e5-493e-b187-955998b020ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] No waiting events found dispatching network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:32:51 user nova-compute[82394]: WARNING nova.compute.manager [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received unexpected event network-vif-plugged-b987249f-523f-4356-bdc9-82518d86209b for instance with vm_state active and task_state deleting.
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a3476-817b-4a2b-b8ad-52e4efd2a34f]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] SCSI volumes sdj have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6503bea8-2537-424e-a750-378e8d70477c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cfa2c8-c45a-4c7d-984d-3a12eca13bc3]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260]
Apr 12 00:32:51 user nova-compute[82394]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65678a70-1c74-42ac-9334-dd959c1ea80f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[68563875-6ce7-4fbe-ac15-fd96843bf972]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] <== disconnect_volume: return (1155ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.351s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e2722-ccb9-4ed6-98c4-fc93df8baa11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: iSNS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: STATIC:
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:52 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb47bd74-5d2c-483b-90c9-3dd8f601d278]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85cfa18-8cde-4cab-8d69-a8d0080c61ac]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23436dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5'): ({'sdh'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Removing single pathed devices sdh {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba36b7-feff-4066-ae86-b241c1d3e428]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[86992800-e18e-4027-8aba-878911e9e3e2]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flushing IO for device /dev/sdh {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2a945-fc8c-4342-8fa6-b34f21ff2fc7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[375babbf-d304-4e97-9fc4-05d887a53c2c]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] SCSI volumes sdh have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8cf1f9-45a7-43bf-8838-43e8d6c7443e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b8705-ec30-4765-beb4-90b299cff515]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260]
Apr 12 00:32:52 user nova-compute[82394]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5598a56-f587-4575-84b7-57159f0481da]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== disconnect_volume: return (691ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xuQsODCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:52 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d2660-05c4-4ee4-9a33-be41595adf08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: iSNS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: STATIC:
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:52 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f189ef7-b738-4cb0-bc94-6ec5121e7110]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1bdec2-3236-4b6a-916b-a56a8bcbb5e0]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c23010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0'): ({'sdf'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Removing single pathed devices sdf {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a66cb4-41b9-4576-84f4-2aae32759d18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0c3ac-c8ad-4a64-8bb6-0f5d82cfafe6]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flushing IO for device /dev/sdf {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b0ed3-fd46-4183-a7a8-575ca9154d35]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0074a1fb-1174-4ef7-a2ad-6e6012da90b9]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26640c-62ac-47ae-885d-854969956821]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Took 0.84 seconds to deallocate network for instance.
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c55b8d-00fd-4a71-a4bc-3c1a86b507fc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260]
Apr 12 00:32:52 user nova-compute[82394]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[82950903-bb9c-435f-96f9-335de9c7b510]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== disconnect_volume: return (347ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYHfuyIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:52 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e227b9-777a-47ba-9ad9-e87464e50346]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: iSNS:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]: STATIC:
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:32:52 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:32:52 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:32:52 user nova-compute[82394]: FIRMWARE:
Apr 12 00:32:52 user nova-compute[82394]: No targets found.
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:32:52 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:32:52 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0337a0f-9a44-4ef8-bf00-c650e909eef4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b68ec2-d566-4cca-8332-fd4e633e3ea4]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 (non-flash)
Apr 12 00:32:52 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:32:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347d2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4'): ({'sdg'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Removing single pathed devices sdg {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadaaefd-988c-4993-abbc-471c5fa6ee21]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b0638-8a7d-4563-a6e3-ba21c119d40a]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flushing IO for device /dev/sdg {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'flavor' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710f1c6-693d-4bb7-8c9c-ddbe5c9b20dc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.332s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cee1a9-389d-45a3-ae57-50f2b0687339]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4230a562-62c6-4939-92ba-b19646072952]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c689063c-8e72-415f-8ae0-d0f91a5eaf49]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260]
Apr 12 00:32:53 user nova-compute[82394]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4, portal: 172.16.0.220,3260] successful.
Apr 12 00:32:53 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85736f3-0744-49a3-a4b9-c65987e67df4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9be05-05c3-4b67-a03a-01573b796ac5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] <== disconnect_volume: return (336ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Deleting instance files /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1_del
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Deletion of /opt/stack/data/nova/instances/f784806a-987f-4861-a23a-dbf961c8b6c1_del complete
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.compute.manager [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Took 5.15 seconds to destroy the instance on the hypervisor.
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.compute.manager [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Deleting volume: 7f8f8733-e863-4c36-bdd5-bdc33446a551 {{(pid=82394) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Received event network-vif-deleted-b987249f-523f-4356-bdc9-82518d86209b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-deleted-b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Neutron deleted interface b09d545e-e05d-42e0-b1d4-46fe7d8a6e46; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.network.neutron [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9c15342-4557-47ce-a9ed-4c378fe66186", "address": "fa:16:3e:4a:c7:40", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c15342-45", "ovs_interfaceid": "b9c15342-4557-47ce-a9ed-4c378fe66186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Detach interface failed, port_id=b09d545e-e05d-42e0-b1d4-46fe7d8a6e46, reason: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-deleted-b9c15342-4557-47ce-a9ed-4c378fe66186 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:53 user nova-compute[82394]: INFO nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Neutron deleted interface b9c15342-4557-47ce-a9ed-4c378fe66186; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.network.neutron [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "address": "fa:16:3e:a8:a1:62", "network": {"id": "f93a64f7-abf3-4107-9031-b3707a5ffdb2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-418328190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad31f866-7d", "ovs_interfaceid": "ad31f866-7d58-49a8-9e24-17ec4ad04a48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Detach interface failed, port_id=b9c15342-4557-47ce-a9ed-4c378fe66186, reason: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:54 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance 7f1f85bf-03e5-493e-b187-955998b020ee
Apr 12 00:32:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "7f1f85bf-03e5-493e-b187-955998b020ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.768s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:54 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-deleted-ad31f866-7d58-49a8-9e24-17ec4ad04a48 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:55 user nova-compute[82394]: INFO nova.compute.manager [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Neutron deleted interface ad31f866-7d58-49a8-9e24-17ec4ad04a48; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:55 user nova-compute[82394]: DEBUG nova.network.neutron [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [{"id": "02d77b15-fb16-44e3-9c20-d319e7302449", "address": "fa:16:3e:d3:ad:4c", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02d77b15-fb", "ovs_interfaceid": "02d77b15-fb16-44e3-9c20-d319e7302449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6903c204-8c47-4dbf-991d-28e91739df40", "address": "fa:16:3e:19:58:44", "network": {"id": "77337857-32d2-403b-b63a-c3c2db169526", "bridge": "br-int", "label": "tempest-device-tagging-net1-1497844937", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6903c204-8c", "ovs_interfaceid": "6903c204-8c47-4dbf-991d-28e91739df40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "address": "fa:16:3e:03:bd:d4", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34faa1f7-7c", "ovs_interfaceid": "34faa1f7-7c0e-4272-a3b6-092979dd46b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "address": "fa:16:3e:fc:b6:ff", "network": {"id": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "bridge": "br-int", "label": "tempest-device-tagging-net2-634685870", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c45d99a301794a748dadf4c96860835c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a80b7d7-aa", "ovs_interfaceid": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Detach interface failed, port_id=ad31f866-7d58-49a8-9e24-17ec4ad04a48, reason: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:56 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Took 7.22 seconds to deallocate network for instance.
Apr 12 00:32:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing instance network info cache due to event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Acquiring lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Acquired lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:32:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:57 user nova-compute[82394]: INFO nova.compute.manager [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Attaching volume e3d41b83-29fb-497c-b972-2dc29864ff1f to /dev/vdb
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.utils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b045e47-7e65-49cd-9cd7-4ee6b93ac193]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d802f24-813a-4c63-b35b-e9692e22c210]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992269a-c18f-4349-bf46-c80ba7187db7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d643c0-de6c-488b-8bad-1be9e0f325d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:32:57 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f9b13-beb7-4aa0-b609-f84cf724666f]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG os_brick.utils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating existing volume attachment record: 360bd802-b217-49fe-b82a-f771a8517eae {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updated VIF entry in instance network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating instance_info_cache with network_info: [{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Releasing lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-deleted-4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-deleted-f9be977e-033f-44cb-adda-1590a13ccbdb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:58 user nova-compute[82394]: INFO nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Neutron deleted interface f9be977e-033f-44cb-adda-1590a13ccbdb; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "09b82fec-ca71-4934-ac24-073ca9080c9c", "address": "fa:16:3e:df:98:aa", "network": {"id": "e45ac6be-a614-418d-afda-8428738f541e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677161687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b82fec-ca", "ovs_interfaceid": "09b82fec-ca71-4934-ac24-073ca9080c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Detach interface failed, port_id=f9be977e-033f-44cb-adda-1590a13ccbdb, reason: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Received event network-vif-deleted-34faa1f7-7c0e-4272-a3b6-092979dd46b8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-deleted-09b82fec-ca71-4934-ac24-073ca9080c9c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:58 user nova-compute[82394]: INFO nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Neutron deleted interface 09b82fec-ca71-4934-ac24-073ca9080c9c; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "address": "fa:16:3e:f9:32:c4", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb8ab354-db", "ovs_interfaceid": "bb8ab354-dbbc-4141-9499-5689ae95fb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Detach interface failed, port_id=09b82fec-ca71-4934-ac24-073ca9080c9c, reason: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-deleted-bb8ab354-dbbc-4141-9499-5689ae95fb2f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:32:58 user nova-compute[82394]: INFO nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Neutron deleted interface bb8ab354-dbbc-4141-9499-5689ae95fb2f; detaching it from the instance and deleting it from the info cache
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [{"id": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "address": "fa:16:3e:db:22:c5", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b6ea381-2a", "ovs_interfaceid": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "address": "fa:16:3e:c7:09:72", "network": {"id": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1447538759", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5703b7-ff", "ovs_interfaceid": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f528d725-8cc8-49c2-8e45-56340893e4c7", "address": "fa:16:3e:1a:f8:fe", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf528d725-8c", "ovs_interfaceid": "f528d725-8cc8-49c2-8e45-56340893e4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "address": "fa:16:3e:70:d8:06", "network": {"id": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "bridge": "br-int", "label": "tempest-device-tagging-net2-181141483", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6b2a25677e14a23ae7b81e2e56c008a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9fcf83-a9", "ovs_interfaceid": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Detach interface failed, port_id=bb8ab354-dbbc-4141-9499-5689ae95fb2f, reason: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:32:59 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:32:59 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Took 5.89 seconds to deallocate network for instance.
Apr 12 00:32:59 user nova-compute[82394]: INFO nova.compute.manager [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Took 2.50 seconds to detach 3 volumes for instance.
Apr 12 00:32:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:32:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:32:59 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:32:59 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:32:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:32:59 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Deleted allocations for instance e3b52368-86be-4211-a37b-522ed3991a00
Apr 12 00:32:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "e3b52368-86be-4211-a37b-522ed3991a00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.853s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-deleted-9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Received event network-vif-deleted-f528d725-8cc8-49c2-8e45-56340893e4c7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:01 user nova-compute[82394]: INFO nova.compute.manager [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Took 2.37 seconds to detach 3 volumes for instance.
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbpiETVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:01 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:01 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:01 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[882bc293-fe72-4fea-b7db-f25cce6aafac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:33:01 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[876372e3-67a3-47b3-b75b-7672d1b1b4e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f] added
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9148d6-42a0-4fab-86ca-e3de007700fb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c532992-863c-4e44-a28e-f4663b7e73d9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbpiETVH {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbpiETVH" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64030b3a-a6a8-4efc-bbd6-9602d60e7003]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZbpiETVH'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8640138-010e-439d-990f-c6ef1f73fbce]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[765155e6-7d04-4190-b8a6-39b08c5b6ba9]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36cb18f-741b-49dc-afc1-7a2b63bdd2ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260]
Apr 12 00:33:01 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Deleted allocations for instance f784806a-987f-4861-a23a-dbf961c8b6c1
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a1d1c-8051-4cfe-ad45-7ac84b9d1730]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2cfbf-e2dc-411f-aa74-a8937fa1cd24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)
Apr 12 00:33:01 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)
Apr 12 00:33:01 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d7117f-a8ab-42a2-8e01-1b750e36bf0f]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "f784806a-987f-4861-a23a-dbf961c8b6c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.987s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259567.096574, e3b52368-86be-4211-a37b-522ed3991a00 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:02 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: e3b52368-86be-4211-a37b-522ed3991a00] VM Stopped (Lifecycle Event)
Apr 12 00:33:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-713d93e0-f593-49d7-8275-0f49c8c70fab None None] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbpiETVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23931643731303134', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931643731303134', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:33:02 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:02 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:02 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:02 user nova-compute[82394]:   <serial>e3d41b83-29fb-497c-b972-2dc29864ff1f</serial>
Apr 12 00:33:02 user nova-compute[82394]: </disk>
Apr 12 00:33:02 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:33:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No VIF found with MAC fa:16:3e:15:62:29, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:33:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.415s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259570.2327147, f784806a-987f-4861-a23a-dbf961c8b6c1 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:05 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] VM Stopped (Lifecycle Event)
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e3f35d67-bbbf-4f9a-a765-04e3e988291b None None] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259570.2400723, 7f1f85bf-03e5-493e-b187-955998b020ee => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:05 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] VM Stopped (Lifecycle Event)
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-0b33785f-1188-430d-9a96-982e4ed81521 None None] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:05 user nova-compute[82394]: INFO nova.compute.manager [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Detaching volume e3d41b83-29fb-497c-b972-2dc29864ff1f
Apr 12 00:33:05 user nova-compute[82394]: INFO nova.virt.block_device [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Attempting to driver detach volume e3d41b83-29fb-497c-b972-2dc29864ff1f from mountpoint /dev/vdb
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Attempting to detach device vdb from instance d25bc2e7-3399-47be-b78d-990acbb51749 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:33:05 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:05 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:05 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:05 user nova-compute[82394]:   <serial>e3d41b83-29fb-497c-b972-2dc29864ff1f</serial>
Apr 12 00:33:05 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:33:05 user nova-compute[82394]: </disk>
Apr 12 00:33:05 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:33:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully detached device vdb from instance d25bc2e7-3399-47be-b78d-990acbb51749 from the persistent domain config.
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d25bc2e7-3399-47be-b78d-990acbb51749 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:33:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:33:05 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:05 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:05 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:05 user nova-compute[82394]:   <serial>e3d41b83-29fb-497c-b972-2dc29864ff1f</serial>
Apr 12 00:33:05 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:33:05 user nova-compute[82394]: </disk>
Apr 12 00:33:05 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259586.4008698, d25bc2e7-3399-47be-b78d-990acbb51749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:33:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully detached device vdb from instance d25bc2e7-3399-47be-b78d-990acbb51749 from the live domain config.
Apr 12 00:33:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbpiETVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:06 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1189c81-b225-4b41-a442-1aa1a282cf12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:33:06 user nova-compute[82394]: No targets found.
Apr 12 00:33:06 user nova-compute[82394]: iSNS:
Apr 12 00:33:06 user nova-compute[82394]: No targets found.
Apr 12 00:33:06 user nova-compute[82394]: STATIC:
Apr 12 00:33:06 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f
Apr 12 00:33:06 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:06 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:06 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:33:06 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:06 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:06 user nova-compute[82394]: FIRMWARE:
Apr 12 00:33:06 user nova-compute[82394]: No targets found.
Apr 12 00:33:06 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:33:06 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:33:06 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[720a671d-5d7a-402b-b8d2-ce4df438ceac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92172597-afa1-4733-b8c3-22dd013d7c20]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)
Apr 12 00:33:06 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:06 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f (non-flash)
Apr 12 00:33:06 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:06 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23431a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced40d1f-4f4c-467c-b3df-465bd0b2f7a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[320896f2-0af4-4231-893f-d7cfd0f3521e]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedbbd9f-3c08-4fd8-b8b5-8c41cb52fbd3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e777d1-fcc6-486d-80bd-711cfe9d528b]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae558b0-af6c-4715-a52a-a5cb7bd3f379]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37adb0-5802-4044-882c-457cc810317b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260]
Apr 12 00:33:06 user nova-compute[82394]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:06 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d41b83-29fb-497c-b972-2dc29864ff1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b981c-869b-435b-9f22-262a594d3133]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== disconnect_volume: return (304ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:33:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing instance network info cache due to event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Acquiring lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Acquired lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.objects.instance [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updated VIF entry in instance network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating instance_info_cache with network_info: [{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:12 user nova-compute[82394]: INFO nova.compute.manager [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attaching volume 43cb1662-3455-4f68-8d31-4beb337e717a to /dev/vdb
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Releasing lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a69860e-db8b-4c18-be29-3b89b460ebfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c9548-37ce-40f7-add9-85e0eab3687d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681ac6d-eb1d-4829-a108-66780ba877f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba06b6-3e6f-4869-b2e0-613f074bc4c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:12 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:33:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b3667-797e-4966-87c1-eb1fe89f2764]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:12 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating existing volume attachment record: dafaf462-ca8b-4972-9878-0a15df6dafa3 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:33:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgvbGDQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:17 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa7302-61c7-4c64-b5d3-7f6d777243be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:33:17 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf0c176-5bec-4443-ac76-df87c665ed7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a] added
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6ce25a-c0af-491e-aaa7-b8acb14ba11b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f604264-376e-4b42-b622-67e31caa7426]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgvbGDQL {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgvbGDQL" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf31bd06-1e86-4bf1-bfec-6809a0b4bd06]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dgvbGDQL'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3602a-baf8-4278-8653-d5f507d3f93a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0781403-e70d-4bc0-9451-cf658212b590]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[674254aa-d81e-48d7-a9c4-695d2a23293c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260]
Apr 12 00:33:17 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe86c3-621e-41a5-abc7-67165cc1515d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893a341-1fc5-4842-aa66-0a69206ba9ae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:17 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:17 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcde70a-891a-4b79-966d-37a915b3396f]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgvbGDQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:33:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23237616635663735', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237616635663735', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:33:18 user nova-compute[82394]: DEBUG nova.objects.instance [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:33:18 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:18 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:18 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:18 user nova-compute[82394]:   <serial>43cb1662-3455-4f68-8d31-4beb337e717a</serial>
Apr 12 00:33:18 user nova-compute[82394]: </disk>
Apr 12 00:33:18 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:33:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No VIF found with MAC fa:16:3e:ad:aa:95, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:33:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.391s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing instance network info cache due to event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updated VIF entry in instance network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:20 user nova-compute[82394]: INFO nova.compute.manager [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Shelve offloading
Apr 12 00:33:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance destroyed successfully.
Apr 12 00:33:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:22 user nova-compute[82394]: WARNING nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state active and task_state shelving.
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:22 user nova-compute[82394]: WARNING nova.compute.manager [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state active and task_state shelving.
Apr 12 00:33:22 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance destroyed successfully.
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'resources' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAGdsPc2kkKFJoMoObq2mhf3wSWiVrIpEKF85Yl7zW57cuaGGXxZfMd81KN/RMSzVQbf9duu6jwp+9gjp4UDunIsZZRYk1GjUolkdqpAK7Qa3hIBA+9wz/IhHmwfXa5Kg==',key_name='tempest-TestShelveInstance-382306594',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:42Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG os_vif [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb796ef8b-d9, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:22 user nova-compute[82394]: INFO os_vif [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9')
Apr 12 00:33:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:22 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing instance network info cache due to event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.network.neutron [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbdefb2-875e-44cf-ac5b-02fb36a24835]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:33:23 user nova-compute[82394]: No targets found.
Apr 12 00:33:23 user nova-compute[82394]: iSNS:
Apr 12 00:33:23 user nova-compute[82394]: No targets found.
Apr 12 00:33:23 user nova-compute[82394]: STATIC:
Apr 12 00:33:23 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a
Apr 12 00:33:23 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:23 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:23 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:33:23 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:23 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:23 user nova-compute[82394]: FIRMWARE:
Apr 12 00:33:23 user nova-compute[82394]: No targets found.
Apr 12 00:33:23 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:33:23 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:33:23 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3f5e3b-00b4-4336-8fb7-3b52b8c15839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9892ce6-4f8e-42f3-a217-acd630247f4f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:23 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:23 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:23 user nova-compute[82394]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:33:23 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb'): ({'sdi'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Removing single pathed devices sdi {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[105c35d6-3794-4d2f-b53c-6064633d491c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ab663c-f36e-4870-b8b6-6322bc02a98c]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flushing IO for device /dev/sdi {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7864bc-bc85-450f-b9fc-62e4c70cfa32]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f231089-9e83-4f81-a226-a6afad1949c1]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] SCSI volumes sdi have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3df353-6fa4-4454-befe-24e8e03a46ad]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518f201-857f-48ef-9fea-f975e291c120]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]
Apr 12 00:33:23 user nova-compute[82394]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:23 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c168a4b-02f0-40c8-a499-4b035a45eafc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== disconnect_volume: return (379ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:33:23 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deleting instance files /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff_del
Apr 12 00:33:23 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deletion of /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff_del complete
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.network.neutron [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updated VIF entry in instance network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG nova.network.neutron [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": null, "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:24 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Deleted allocations for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff
Apr 12 00:33:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'numa_topology' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:25 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:25 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.246s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:26 user nova-compute[82394]: INFO nova.compute.manager [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Terminating instance
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:26 user nova-compute[82394]: INFO nova.compute.manager [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Terminating instance
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-unplugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] No waiting events found dispatching network-vif-unplugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-unplugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-unplugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-unplugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-unplugged-47b92afd-7a5c-49a0-aea8-abccac5e350c for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:26 user nova-compute[82394]: INFO nova.compute.manager [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Detaching volume 43cb1662-3455-4f68-8d31-4beb337e717a
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.block_device [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attempting to driver detach volume 43cb1662-3455-4f68-8d31-4beb337e717a from mountpoint /dev/vdb
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Attempting to detach device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:33:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:27 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:27 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:27 user nova-compute[82394]:   <serial>43cb1662-3455-4f68-8d31-4beb337e717a</serial>
Apr 12 00:33:27 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:33:27 user nova-compute[82394]: </disk>
Apr 12 00:33:27 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:33:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:27 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:27 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:27 user nova-compute[82394]:   <serial>43cb1662-3455-4f68-8d31-4beb337e717a</serial>
Apr 12 00:33:27 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:33:27 user nova-compute[82394]: </disk>
Apr 12 00:33:27 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259607.629923, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgvbGDQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:27 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Instance destroyed successfully.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'resources' on Instance uuid 570abef1-f803-4f3e-8051-b6f690063496 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909783913',display_name='tempest-ServersNegativeTestJSON-server-909783913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909783913',id=14,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-bta30xjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:44Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=570abef1-f803-4f3e-8051-b6f690063496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "address": "fa:16:3e:cd:55:1a", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b9ee8-e9", "ovs_interfaceid": "6e0b9ee8-e941-48ea-9659-8e837577d4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_vif [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff6343-45c1-4c19-9e8c-639f69d62a8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:33:27 user nova-compute[82394]: No targets found.
Apr 12 00:33:27 user nova-compute[82394]: iSNS:
Apr 12 00:33:27 user nova-compute[82394]: No targets found.
Apr 12 00:33:27 user nova-compute[82394]: STATIC:
Apr 12 00:33:27 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a
Apr 12 00:33:27 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:27 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:27 user nova-compute[82394]: FIRMWARE:
Apr 12 00:33:27 user nova-compute[82394]: No targets found.
Apr 12 00:33:27 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:33:27 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:33:27 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e0b9ee8-e9, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Instance destroyed successfully.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'resources' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T00:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1251564681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1251564681',id=7,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg==',key_name='tempest-keypair-471743196',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7abb0634c7c44699a5197b9876b612c',ramdisk_id='',reservation_id='r-bi2zc047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-552970798',owner_user_name='tempest-TaggedAttachmentsTest-552970798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dae26de34e047b8b4fe08b2e56a4b62',uuid=f9dc12da-4db1-4305-93ea-2bd63870c097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converting VIF {"id": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "address": "fa:16:3e:89:48:de", "network": {"id": "18644b33-51c6-42ac-af84-c3d28fca37c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1569505928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7abb0634c7c44699a5197b9876b612c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b92afd-7a", "ovs_interfaceid": "47b92afd-7a5c-49a0-aea8-abccac5e350c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_vif [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:33:27 user nova-compute[82394]: INFO os_vif [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=6e0b9ee8-e941-48ea-9659-8e837577d4bb,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b9ee8-e9')
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Deleting instance files /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496_del
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Deletion of /opt/stack/data/nova/instances/570abef1-f803-4f3e-8051-b6f690063496_del complete
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7416da-148e-4bb3-bf89-0da8c0794321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47b92afd-7a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:27 user nova-compute[82394]: INFO os_vif [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:48:de,bridge_name='br-int',has_traffic_filtering=True,id=47b92afd-7a5c-49a0-aea8-abccac5e350c,network=Network(18644b33-51c6-42ac-af84-c3d28fca37c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b92afd-7a')
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Deleting instance files /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097_del
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Deletion of /opt/stack/data/nova/instances/f9dc12da-4db1-4305-93ea-2bd63870c097_del complete
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b4c42d-bc11-455a-8a7f-7706c69cf2fd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:27 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a (non-flash)
Apr 12 00:33:27 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c87520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d0b6b0-9e0b-489b-ab2e-1ef4814b6c80]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.compute.manager [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Took 1.50 seconds to destroy the instance on the hypervisor.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af600267-fd14-4e0e-93dc-3e7afdf07637]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8cb613-4e23-46ae-bce4-db8e39fccba9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: INFO nova.compute.manager [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Took 1.54 seconds to destroy the instance on the hypervisor.
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d645d3-bbef-4693-b2fb-c674032a6e71]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7310e-2771-43b9-8c1f-1474f4cb3e4d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495e1a7-021f-4eef-ab30-53f97e48bb97]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260]
Apr 12 00:33:27 user nova-compute[82394]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:27 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cb1662-3455-4f68-8d31-4beb337e717a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260fa49-6645-47c6-930c-de1d0d5cbc9c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== disconnect_volume: return (310ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Acquiring lock "570abef1-f803-4f3e-8051-b6f690063496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Lock "570abef1-f803-4f3e-8051-b6f690063496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] No waiting events found dispatching network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:28 user nova-compute[82394]: WARNING nova.compute.manager [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received unexpected event network-vif-plugged-6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance with vm_state active and task_state deleting.
Apr 12 00:33:28 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Acquiring lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] No waiting events found dispatching network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:28 user nova-compute[82394]: WARNING nova.compute.manager [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received unexpected event network-vif-plugged-47b92afd-7a5c-49a0-aea8-abccac5e350c for instance with vm_state active and task_state deleting.
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:29 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Took 1.29 seconds to deallocate network for instance.
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Received event network-vif-deleted-6e0b9ee8-e941-48ea-9659-8e837577d4bb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:29 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Took 1.49 seconds to deallocate network for instance.
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.074s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:29 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Deleted allocations for instance 570abef1-f803-4f3e-8051-b6f690063496
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "570abef1-f803-4f3e-8051-b6f690063496" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:29 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Deleted allocations for instance f9dc12da-4db1-4305-93ea-2bd63870c097
Apr 12 00:33:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "f9dc12da-4db1-4305-93ea-2bd63870c097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Received event network-vif-deleted-47b92afd-7a5c-49a0-aea8-abccac5e350c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:36 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259601.6795585, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:36 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Stopped (Lifecycle Event)
Apr 12 00:33:36 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e9998bca-7bdf-40e5-96ce-ecd971f40554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:39 user nova-compute[82394]: INFO nova.compute.manager [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Terminating instance
Apr 12 00:33:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-unplugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] No waiting events found dispatching network-vif-unplugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-unplugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:33:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Instance destroyed successfully.
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'resources' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-616241968',display_name='tempest-TestVolumeSwap-server-616241968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-616241968',id=5,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqavOG73YHP/jCE8QYd9eB/mTDgD50nbY+MW+ec/fUDNZvJ4gLz94SBNm7woJpGnkkYo5CN6rOisg49f1aZtON5pBAxIRrPclADfCbPyd0Gh0X+A28pjj3Xe6fQGyNlA==',key_name='tempest-keypair-436204141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bff88f0df3414610858ecf3d60295c26',ramdisk_id='',reservation_id='r-yy10724y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1224322718',owner_user_name='tempest-TestVolumeSwap-1224322718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4edaa34382341fd8f99f9d0921d80b6',uuid=5be536dd-61f5-4a17-a734-029b25739a47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converting VIF {"id": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "address": "fa:16:3e:bb:9e:ad", "network": {"id": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-185627423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff88f0df3414610858ecf3d60295c26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2a7afd-3e", "ovs_interfaceid": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG os_vif [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb2a7afd-3e, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:40 user nova-compute[82394]: INFO os_vif [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:9e:ad,bridge_name='br-int',has_traffic_filtering=True,id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9,network=Network(f1b0803c-dc20-47d1-8c89-af2a7f867e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2a7afd-3e')
Apr 12 00:33:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Deleting instance files /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47_del
Apr 12 00:33:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Deletion of /opt/stack/data/nova/instances/5be536dd-61f5-4a17-a734-029b25739a47_del complete
Apr 12 00:33:40 user nova-compute[82394]: INFO nova.compute.manager [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 00:33:40 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:33:40 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:33:41 user nova-compute[82394]: INFO nova.compute.claims [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Claim successful on node user
Apr 12 00:33:41 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Took 0.85 seconds to deallocate network for instance.
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-deleted-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:41 user nova-compute[82394]: INFO nova.compute.manager [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Neutron deleted interface bb2a7afd-3e9c-4291-82ff-c443bee5c1f9; detaching it from the instance and deleting it from the info cache
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.network.neutron [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Detach interface failed, port_id=bb2a7afd-3e9c-4291-82ff-c443bee5c1f9, reason: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.307s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:33:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.policy [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Acquiring lock "5be536dd-61f5-4a17-a734-029b25739a47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Lock "5be536dd-61f5-4a17-a734-029b25739a47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] No waiting events found dispatching network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:42 user nova-compute[82394]: WARNING nova.compute.manager [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Received unexpected event network-vif-plugged-bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance with vm_state deleted and task_state None.
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:33:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Creating image(s)
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "/opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:42 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Deleted allocations for instance 5be536dd-61f5-4a17-a734-029b25739a47
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259607.646835, 570abef1-f803-4f3e-8051-b6f690063496 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:42 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 570abef1-f803-4f3e-8051-b6f690063496] VM Stopped (Lifecycle Event)
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "5be536dd-61f5-4a17-a734-029b25739a47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259607.6666937, f9dc12da-4db1-4305-93ea-2bd63870c097 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:42 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] VM Stopped (Lifecycle Event)
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1abace9d-145a-4c68-8be7-f0e96be2a3b8 None None] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.194s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-a072576b-05b9-42f7-9bd1-09c77ffa678c None None] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk 1073741824" returned: 0 in 0.053s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Successfully created port: 203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Cannot resize image /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.objects.instance [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'migration_context' on Instance uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.objects.instance [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'flavor' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Ensure instance console log exists: /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:43 user nova-compute[82394]: INFO nova.compute.manager [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attaching volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 to /dev/vdb
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.utils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f65fbc-1e6f-4be6-9f01-18c7b529bd2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb580e8a-f839-4ede-83e1-f659db1f7b9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0f8fa-ff0d-427d-abd4-60c27553c6e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92697eb2-bffd-4cc1-ac2f-b078e5a31265]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:43 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9920a-1f36-4dcb-af25-ebf011805f84]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG os_brick.utils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating existing volume attachment record: c20f16c4-75df-4a0c-8a60-64d8736a62eb {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Successfully updated port: 203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-changed-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Refreshing instance network info cache due to event network-changed-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:43 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Instance network_info: |[{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.neutron [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Refreshing network info cache for port 203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Start _get_guest_xml network_info=[{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:33:44 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:44 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1962160944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1962160944',id=15,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-057en8me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:42Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.objects.instance [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:33:44 user nova-compute[82394]:   <uuid>a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88</uuid>
Apr 12 00:33:44 user nova-compute[82394]:   <name>instance-0000000f</name>
Apr 12 00:33:44 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:33:44 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:33:44 user nova-compute[82394]:   <metadata>
Apr 12 00:33:44 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:33:44 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1962160944</nova:name>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:33:44</nova:creationTime>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:33:44 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:33:44 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:owner>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:33:44 user nova-compute[82394]:       </nova:owner>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:33:44 user nova-compute[82394]:       <nova:ports>
Apr 12 00:33:44 user nova-compute[82394]:         <nova:port uuid="203d6c33-a06b-4c9a-88e9-dbd8e823a6e5">
Apr 12 00:33:44 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:33:44 user nova-compute[82394]:         </nova:port>
Apr 12 00:33:44 user nova-compute[82394]:       </nova:ports>
Apr 12 00:33:44 user nova-compute[82394]:     </nova:instance>
Apr 12 00:33:44 user nova-compute[82394]:   </metadata>
Apr 12 00:33:44 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:33:44 user nova-compute[82394]:     <system>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="serial">a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88</entry>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="uuid">a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88</entry>
Apr 12 00:33:44 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:33:44 user nova-compute[82394]:     </system>
Apr 12 00:33:44 user nova-compute[82394]:   </sysinfo>
Apr 12 00:33:44 user nova-compute[82394]:   <os>
Apr 12 00:33:44 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:33:44 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:33:44 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:33:44 user nova-compute[82394]:   </os>
Apr 12 00:33:44 user nova-compute[82394]:   <features>
Apr 12 00:33:44 user nova-compute[82394]:     <acpi/>
Apr 12 00:33:44 user nova-compute[82394]:     <apic/>
Apr 12 00:33:44 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:33:44 user nova-compute[82394]:   </features>
Apr 12 00:33:44 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:33:44 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:33:44 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:33:44 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:33:44 user nova-compute[82394]:   </clock>
Apr 12 00:33:44 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:33:44 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:33:44 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:33:44 user nova-compute[82394]:   </cpu>
Apr 12 00:33:44 user nova-compute[82394]:   <devices>
Apr 12 00:33:44 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:33:44 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:33:44 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk"/>
Apr 12 00:33:44 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:33:44 user nova-compute[82394]:     </disk>
Apr 12 00:33:44 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:33:44 user nova-compute[82394]:       <mac address="fa:16:3e:bb:16:d4"/>
Apr 12 00:33:44 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:33:44 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:33:44 user nova-compute[82394]:       <target dev="tap203d6c33-a0"/>
Apr 12 00:33:44 user nova-compute[82394]:     </interface>
Apr 12 00:33:44 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:33:44 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/console.log" append="off"/>
Apr 12 00:33:44 user nova-compute[82394]:     </serial>
Apr 12 00:33:44 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:33:44 user nova-compute[82394]:     <video>
Apr 12 00:33:44 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:33:44 user nova-compute[82394]:     </video>
Apr 12 00:33:44 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:33:44 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:33:44 user nova-compute[82394]:     </rng>
Apr 12 00:33:44 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:33:44 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:33:44 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:33:44 user nova-compute[82394]:     </memballoon>
Apr 12 00:33:44 user nova-compute[82394]:   </devices>
Apr 12 00:33:44 user nova-compute[82394]: </domain>
Apr 12 00:33:44 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1962160944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1962160944',id=15,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-057en8me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:42Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG os_vif [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203d6c33-a0, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap203d6c33-a0, col_values=(('external_ids', {'iface-id': '203d6c33-a06b-4c9a-88e9-dbd8e823a6e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:16:d4', 'vm-uuid': 'a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:44 user nova-compute[82394]: INFO os_vif [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0')
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:bb:16:d4, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.neutron [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updated VIF entry in instance network info cache for port 203d6c33-a06b-4c9a-88e9-dbd8e823a6e5. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG nova.network.neutron [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] No waiting events found dispatching network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:46 user nova-compute[82394]: WARNING nova.compute.manager [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received unexpected event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance with vm_state building and task_state spawning.
Apr 12 00:33:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259628.3562663, a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] VM Resumed (Lifecycle Event)
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Instance spawned successfully.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259628.3603766, a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] VM Started (Lifecycle Event)
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] No waiting events found dispatching network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:48 user nova-compute[82394]: WARNING nova.compute.manager [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received unexpected event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance with vm_state building and task_state spawning.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: INFO nova.compute.manager [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Took 7.02 seconds to build instance.
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.339s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:49 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:49 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:49 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fc246d-d2d5-4610-84e7-2cb8139ea935]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:33:49 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98376b2-a463-4918-83bb-c4b0ea7e7cad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2] added
Apr 12 00:33:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366ab82-793f-494a-b8cb-10c855041b09]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b69f83-4c5e-45ec-8940-8639a24faf3f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmniFKtw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmniFKtw" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1197e2-3539-49dd-949a-a064a7658720]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmniFKtw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667bf04-396b-4d5f-a885-e5a74a8062f4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc6ded7-ec38-42ff-9ce8-8f0fe2ed13e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:33:49 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:33:49 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:49 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 00:33:49 user nova-compute[82394]: 
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8addc86f-22a6-4b25-a392-d66c7c43af5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]
Apr 12 00:33:49 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b9c509-fb28-4cf1-8c14-60123ac93613]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd979513-a302-484a-bba5-e501972c6da5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:33:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:33:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1a6da-5e95-4202-84af-5f27f75999fe]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=26.618865966796875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23736386562333338', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736386562333338', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'flavor' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:33:50 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:50 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:50 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:50 user nova-compute[82394]:   <serial>d0edc110-1f0c-4311-b54d-6de6a1d1d8f2</serial>
Apr 12 00:33:50 user nova-compute[82394]: </disk>
Apr 12 00:33:50 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:33:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:a1:e7:04, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:33:51 user nova-compute[82394]: INFO nova.compute.claims [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Claim successful on node user
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.035s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:33:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:33:51 user nova-compute[82394]: INFO nova.virt.block_device [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Booting with volume ca06330d-06f4-4f25-8449-2e03b021dc3b at /dev/vda
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG os_brick.utils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac4bcd-be16-4baa-add1-8025e361b721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG nova.policy [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056b7fc-e5bc-4c2d-9d04-b8da74866a29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adc2dd-6eb1-478a-8bd8-8bcc35d1ae92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51643ce-38fa-4cbe-854c-acda359996d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:52 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:33:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e88678f-528b-49b4-8e85-b3e95fb3158e]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG os_brick.utils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Updating existing volume attachment record: 67f0f9f2-c7cd-4eed-b985-d010b5717473 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:33:52 user nova-compute[82394]: INFO nova.compute.manager [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Rebuilding instance
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_requests' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'migration_context' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82394) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:53 user nova-compute[82394]: WARNING nova.compute.manager [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state rebuilding.
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:33:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance destroyed successfully.
Apr 12 00:33:53 user nova-compute[82394]: INFO nova.compute.manager [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Detaching volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:33:53 user nova-compute[82394]: INFO nova.virt.block_device [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attempting to driver detach volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 from mountpoint /dev/vdb
Apr 12 00:33:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Attempting to detach device vdb from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:33:54 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:54 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:33:54 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:33:54 user nova-compute[82394]:   <serial>d0edc110-1f0c-4311-b54d-6de6a1d1d8f2</serial>
Apr 12 00:33:54 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:33:54 user nova-compute[82394]: </disk>
Apr 12 00:33:54 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Successfully created port: 5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:33:54 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully detached device vdb from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the persistent domain config.
Apr 12 00:33:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:54 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65159f7-4a16-4cc3-8d4e-488a2aa6566d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:33:54 user nova-compute[82394]: No targets found.
Apr 12 00:33:54 user nova-compute[82394]: iSNS:
Apr 12 00:33:54 user nova-compute[82394]: No targets found.
Apr 12 00:33:54 user nova-compute[82394]: STATIC:
Apr 12 00:33:54 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:33:54 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:33:54 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:33:54 user nova-compute[82394]: FIRMWARE:
Apr 12 00:33:54 user nova-compute[82394]: No targets found.
Apr 12 00:33:54 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:33:54 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:33:54 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b29ad-8d32-460b-a194-68ad7c1bd69e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bccc80d-a5e5-4c1e-80e3-32acae4a3908]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:33:54 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:33:54 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c20310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e88208-53db-4c4e-82f0-847d6db5a9f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f03ad-788e-4367-be1a-07a1ccab4ea5]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee67c3d-3575-4928-ab15-403f8d0ccb57]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[50adde44-87f6-4742-9fff-fcb544040c35]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[31701746-0e91-44e9-8f6a-c82e0685f32a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ff2ac-d02a-4953-8255-f1f0cc2234c7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]
Apr 12 00:33:54 user nova-compute[82394]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:54 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1972d8b-1425-4479-b51c-9233baef6413]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (339ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:33:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance destroyed successfully.
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99b54c2-0b, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:55 user nova-compute[82394]: INFO os_vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:55 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Successfully updated port: 5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fad3a08c-72fb-4acd-a499-a157b050c9e9]: Unexpected error while running command.
Apr 12 00:33:55 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 00:33:55 user nova-compute[82394]: Exit code: 21
Apr 12 00:33:55 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 00:33:55 user nova-compute[82394]: Stderr: '' {{(pid=92359) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 12 00:33:55 user nova-compute[82394]: Traceback (most recent call last):
Apr 12 00:33:55 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 12 00:33:55 user nova-compute[82394]:     ret = func(*f_args, **f_kwargs)
Apr 12 00:33:55 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 12 00:33:55 user nova-compute[82394]:     return func(*args, **kwargs)
Apr 12 00:33:55 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 12 00:33:55 user nova-compute[82394]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 12 00:33:55 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 12 00:33:55 user nova-compute[82394]:     return putils.execute(on_execute=on_execute,
Apr 12 00:33:55 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 12 00:33:55 user nova-compute[82394]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 12 00:33:55 user nova-compute[82394]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 00:33:55 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 00:33:55 user nova-compute[82394]: Exit code: 21
Apr 12 00:33:55 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 00:33:55 user nova-compute[82394]: Stderr: ''
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3a08c-72fb-4acd-a499-a157b050c9e9]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 00:33:55 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 00:33:55 user nova-compute[82394]: Exit code: 21
Apr 12 00:33:55 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 00:33:55 user nova-compute[82394]: Stderr: ''
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4084, in _do_rebuild_instance
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 12 00:33:55 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=82394) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (42ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:33:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Deleting instance files /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_del
Apr 12 00:33:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Deletion of /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_del complete
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-changed-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Refreshing instance network info cache due to event network-changed-5512329a-21f4-4114-b881-ede435da55c8. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Acquiring lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:33:55 user nova-compute[82394]: INFO nova.virt.block_device [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Booting with volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 at /dev/vdb
Apr 12 00:33:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.utils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d03c5-a666-48db-9e59-7924b4ebde96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:33:55 user nova-compute[82394]: WARNING nova.compute.manager [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state rebuild_block_device_mapping.
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[132449a7-480d-4fb9-bf3d-37fd3ba3546e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae730dc9-76d1-473e-8473-eb3cb11aeb8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[08426cda-a84f-4f02-9f1b-b584071b3388]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259620.7542984, 5be536dd-61f5-4a17-a734-029b25739a47 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:33:55 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] VM Stopped (Lifecycle Event)
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Updating instance_info_cache with network_info: [{"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1f39ee92-108b-4b17-bae9-013a8a723663 None None] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Instance network_info: |[{"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Acquired lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Refreshing network info cache for port 5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:33:55 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:33:55 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7760b-8493-44cb-9777-2b12aa51bac6]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG os_brick.utils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:55 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating existing volume attachment record: 0299ebc0-ad1e-4a85-9556-d19bed6872ad {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:33:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Updated VIF entry in instance network info cache for port 5512329a-21f4-4114-b881-ede435da55c8. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:33:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Updating instance_info_cache with network_info: [{"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:33:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Releasing lock "refresh_cache-d8833bad-d30f-4cd4-aa66-10d60c782061" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:33:57 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Creating image(s)
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Ensure instance console log exists: /opt/stack/data/nova/instances/d8833bad-d30f-4cd4-aa66-10d60c782061/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Start _get_guest_xml network_info=[{"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '67f0f9f2-c7cd-4eed-b985-d010b5717473', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWUYElMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8833bad-d30f-4cd4-aa66-10d60c782061', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca06330d-06f4-4f25-8449-2e03b021dc3b', 'serial': 'ca06330d-06f4-4f25-8449-2e03b021dc3b'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:33:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWUYElMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:33:57 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:57 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:33:57 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdef19d-0775-4fe6-82b9-76d7540cb2ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:33:57 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaecd4be-750e-4fb0-891e-64c526c77bfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b] added
Apr 12 00:33:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be43e30-a0a6-4c9d-91a3-be9bb46ec976]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37c6a0-5241-4ce2-8a58-36efb1afbfe3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWUYElMo {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWUYElMo" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f9389-07c4-42ae-b734-be29aff2fb54]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWUYElMo'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e42abde-7c7f-4f3f-b584-fb9a470f71aa]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbdac06-c532-4db6-899f-05cea9fb30ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:33:57 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:33:57 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:57 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 00:33:57 user nova-compute[82394]: 
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee51b64-a799-4093-8437-8ab05ddf81c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260]
Apr 12 00:33:57 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260] successful.
Apr 12 00:33:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbc5272-d28c-42d9-9489-6dddfedce0f9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7d7c41-abe1-4314-a204-73717bb6d95b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:33:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:33:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:33:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:33:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:33:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[378743e9-4fd1-4e38-85ef-66bb7a271fc9]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:33:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWUYElMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23838386463343337', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838386463343337', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-84409472',display_name='tempest-TestVolumeBootPattern-volume-backed-server-84409472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-84409472',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-0r6j9vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:52Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=d8833bad-d30f-4cd4-aa66-10d60c782061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.objects.instance [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid d8833bad-d30f-4cd4-aa66-10d60c782061 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:33:59 user nova-compute[82394]:   <uuid>d8833bad-d30f-4cd4-aa66-10d60c782061</uuid>
Apr 12 00:33:59 user nova-compute[82394]:   <name>instance-00000010</name>
Apr 12 00:33:59 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:33:59 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:33:59 user nova-compute[82394]:   <metadata>
Apr 12 00:33:59 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:33:59 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:33:59 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-84409472</nova:name>
Apr 12 00:33:59 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:33:57</nova:creationTime>
Apr 12 00:33:59 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:33:59 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:33:59 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:33:59 user nova-compute[82394]:       <nova:owner>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:33:59 user nova-compute[82394]:       </nova:owner>
Apr 12 00:33:59 user nova-compute[82394]:       <nova:ports>
Apr 12 00:33:59 user nova-compute[82394]:         <nova:port uuid="5512329a-21f4-4114-b881-ede435da55c8">
Apr 12 00:33:59 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:33:59 user nova-compute[82394]:         </nova:port>
Apr 12 00:33:59 user nova-compute[82394]:       </nova:ports>
Apr 12 00:33:59 user nova-compute[82394]:     </nova:instance>
Apr 12 00:33:59 user nova-compute[82394]:   </metadata>
Apr 12 00:33:59 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:33:59 user nova-compute[82394]:     <system>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="serial">d8833bad-d30f-4cd4-aa66-10d60c782061</entry>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="uuid">d8833bad-d30f-4cd4-aa66-10d60c782061</entry>
Apr 12 00:33:59 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:33:59 user nova-compute[82394]:     </system>
Apr 12 00:33:59 user nova-compute[82394]:   </sysinfo>
Apr 12 00:33:59 user nova-compute[82394]:   <os>
Apr 12 00:33:59 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:33:59 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:33:59 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:33:59 user nova-compute[82394]:   </os>
Apr 12 00:33:59 user nova-compute[82394]:   <features>
Apr 12 00:33:59 user nova-compute[82394]:     <acpi/>
Apr 12 00:33:59 user nova-compute[82394]:     <apic/>
Apr 12 00:33:59 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:33:59 user nova-compute[82394]:   </features>
Apr 12 00:33:59 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:33:59 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:33:59 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:33:59 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:33:59 user nova-compute[82394]:   </clock>
Apr 12 00:33:59 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:33:59 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:33:59 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:33:59 user nova-compute[82394]:   </cpu>
Apr 12 00:33:59 user nova-compute[82394]:   <devices>
Apr 12 00:33:59 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:33:59 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:33:59 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:33:59 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:33:59 user nova-compute[82394]:       <serial>ca06330d-06f4-4f25-8449-2e03b021dc3b</serial>
Apr 12 00:33:59 user nova-compute[82394]:     </disk>
Apr 12 00:33:59 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:33:59 user nova-compute[82394]:       <mac address="fa:16:3e:89:73:c0"/>
Apr 12 00:33:59 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:33:59 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:33:59 user nova-compute[82394]:       <target dev="tap5512329a-21"/>
Apr 12 00:33:59 user nova-compute[82394]:     </interface>
Apr 12 00:33:59 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:33:59 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/d8833bad-d30f-4cd4-aa66-10d60c782061/console.log" append="off"/>
Apr 12 00:33:59 user nova-compute[82394]:     </serial>
Apr 12 00:33:59 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:33:59 user nova-compute[82394]:     <video>
Apr 12 00:33:59 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:33:59 user nova-compute[82394]:     </video>
Apr 12 00:33:59 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:33:59 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:33:59 user nova-compute[82394]:     </rng>
Apr 12 00:33:59 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:33:59 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:33:59 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:33:59 user nova-compute[82394]:     </memballoon>
Apr 12 00:33:59 user nova-compute[82394]:   </devices>
Apr 12 00:33:59 user nova-compute[82394]: </domain>
Apr 12 00:33:59 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-84409472',display_name='tempest-TestVolumeBootPattern-volume-backed-server-84409472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-84409472',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-0r6j9vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:52Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=d8833bad-d30f-4cd4-aa66-10d60c782061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG os_vif [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5512329a-21, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5512329a-21, col_values=(('external_ids', {'iface-id': '5512329a-21f4-4114-b881-ede435da55c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:73:c0', 'vm-uuid': 'd8833bad-d30f-4cd4-aa66-10d60c782061'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:33:59 user nova-compute[82394]: INFO os_vif [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21')
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:89:73:c0, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:33:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:33:59 user nova-compute[82394]: INFO nova.compute.manager [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] instance snapshotting
Apr 12 00:33:59 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Beginning live snapshot process
Apr 12 00:33:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86.delta 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86.delta 1073741824" returned: 0 in 0.057s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 00:34:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:34:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating image(s)
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] No waiting events found dispatching network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:00 user nova-compute[82394]: WARNING nova.compute.manager [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received unexpected event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 for instance with vm_state building and task_state spawning.
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.176s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.170s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk 1073741824" returned: 0 in 0.047s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Cannot resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Ensure instance console log exists: /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start _get_guest_xml network_info=[{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0299ebc0-ad1e-4a85-9556-d19bed6872ad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'serial': 'd0edc110-1f0c-4311-b54d-6de6a1d1d8f2'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:34:01 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 00:34:01 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:34:01 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:34:01 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:34:01 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193ee26-991b-4195-b2ef-20d2d704552e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:34:01 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a89718-7fa6-4d7e-8252-9cd37df553fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2] added
Apr 12 00:34:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a8c64-79f3-4782-a00a-11999e39aec3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151f4fd-9239-4868-9430-bc481547a9c7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmniFKtw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmniFKtw" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988bfc7-0466-46ac-a4b9-1e09a0c5f163]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmniFKtw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b374227-3de6-4531-93aa-a74682b26476]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf403e-bdf7-4993-ab7a-aca67f652762]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:34:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:34:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 00:34:02 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86.delta /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86.delta /opt/stack/data/nova/instances/snapshots/tmpkd_t3b_q/29bfb650755d4dd0927576c92473ce86" returned: 0 in 0.415s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Snapshot extracted, beginning image upload
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a4e01-b8b9-4220-b357-828fdd22014e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]
Apr 12 00:34:02 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.
Apr 12 00:34:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac142918-f8d6-46fb-91a6-3ce4d23a8d6e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] No waiting events found dispatching network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:02 user nova-compute[82394]: WARNING nova.compute.manager [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received unexpected event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 for instance with vm_state building and task_state spawning.
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d966f9-9fda-47d9-8f49-633112398fd4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:02 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:02 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.338s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b79ab0-0ffc-49ba-a29f-2f5421a55c74]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:34:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259643.8248868, d8833bad-d30f-4cd4-aa66-10d60c782061 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] VM Resumed (Lifecycle Event)
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Instance spawned successfully.
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259643.8316858, d8833bad-d30f-4cd4-aa66-10d60c782061 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] VM Started (Lifecycle Event)
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:03 user nova-compute[82394]: INFO nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Took 6.36 seconds to spawn the instance on the hypervisor.
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.379s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (2381ms) {'type': 'block', 'scsi_wwn': '23736386562333338', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:34:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736386562333338', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:34:04 user nova-compute[82394]:   <uuid>dbe6d6bc-65a6-469a-89a0-7e4c51620b14</uuid>
Apr 12 00:34:04 user nova-compute[82394]:   <name>instance-00000004</name>
Apr 12 00:34:04 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:34:04 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:34:04 user nova-compute[82394]:   <metadata>
Apr 12 00:34:04 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:34:04 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-197146176</nova:name>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:34:01</nova:creationTime>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:34:04 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:34:04 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:owner>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:34:04 user nova-compute[82394]:       </nova:owner>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:34:04 user nova-compute[82394]:       <nova:ports>
Apr 12 00:34:04 user nova-compute[82394]:         <nova:port uuid="b99b54c2-0b21-42ea-91d0-087aa230da7e">
Apr 12 00:34:04 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:34:04 user nova-compute[82394]:         </nova:port>
Apr 12 00:34:04 user nova-compute[82394]:       </nova:ports>
Apr 12 00:34:04 user nova-compute[82394]:     </nova:instance>
Apr 12 00:34:04 user nova-compute[82394]:   </metadata>
Apr 12 00:34:04 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:34:04 user nova-compute[82394]:     <system>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="serial">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="uuid">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:34:04 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:34:04 user nova-compute[82394]:     </system>
Apr 12 00:34:04 user nova-compute[82394]:   </sysinfo>
Apr 12 00:34:04 user nova-compute[82394]:   <os>
Apr 12 00:34:04 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:34:04 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:34:04 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:34:04 user nova-compute[82394]:   </os>
Apr 12 00:34:04 user nova-compute[82394]:   <features>
Apr 12 00:34:04 user nova-compute[82394]:     <acpi/>
Apr 12 00:34:04 user nova-compute[82394]:     <apic/>
Apr 12 00:34:04 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:34:04 user nova-compute[82394]:   </features>
Apr 12 00:34:04 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:34:04 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:34:04 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:34:04 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:34:04 user nova-compute[82394]:   </clock>
Apr 12 00:34:04 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:34:04 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:34:04 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:34:04 user nova-compute[82394]:   </cpu>
Apr 12 00:34:04 user nova-compute[82394]:   <devices>
Apr 12 00:34:04 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:04 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:04 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk"/>
Apr 12 00:34:04 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:34:04 user nova-compute[82394]:     </disk>
Apr 12 00:34:04 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:34:04 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:34:04 user nova-compute[82394]:       <source dev="/dev/sdc"/>
Apr 12 00:34:04 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:34:04 user nova-compute[82394]:       <serial>d0edc110-1f0c-4311-b54d-6de6a1d1d8f2</serial>
Apr 12 00:34:04 user nova-compute[82394]:     </disk>
Apr 12 00:34:04 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:34:04 user nova-compute[82394]:       <mac address="fa:16:3e:a1:e7:04"/>
Apr 12 00:34:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:04 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:34:04 user nova-compute[82394]:       <target dev="tapb99b54c2-0b"/>
Apr 12 00:34:04 user nova-compute[82394]:     </interface>
Apr 12 00:34:04 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:34:04 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log" append="off"/>
Apr 12 00:34:04 user nova-compute[82394]:     </serial>
Apr 12 00:34:04 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:34:04 user nova-compute[82394]:     <video>
Apr 12 00:34:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:04 user nova-compute[82394]:     </video>
Apr 12 00:34:04 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:34:04 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:34:04 user nova-compute[82394]:     </rng>
Apr 12 00:34:04 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:34:04 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:34:04 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:34:04 user nova-compute[82394]:     </memballoon>
Apr 12 00:34:04 user nova-compute[82394]:   </devices>
Apr 12 00:34:04 user nova-compute[82394]: </domain>
Apr 12 00:34:04 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG os_vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:34:04 user nova-compute[82394]: INFO nova.compute.manager [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Took 12.89 seconds to build instance.
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99b54c2-0b, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb99b54c2-0b, col_values=(('external_ids', {'iface-id': 'b99b54c2-0b21-42ea-91d0-087aa230da7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e7:04', 'vm-uuid': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:04 user nova-compute[82394]: INFO os_vif [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:34:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.019s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:a1:e7:04, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Snapshot image upload complete
Apr 12 00:34:05 user nova-compute[82394]: INFO nova.compute.manager [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Took 6.01 seconds to snapshot the instance on the hypervisor.
Apr 12 00:34:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:06 user nova-compute[82394]: WARNING nova.compute.manager [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state rebuild_spawning.
Apr 12 00:34:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:08 user nova-compute[82394]: WARNING nova.compute.manager [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state rebuild_spawning.
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for dbe6d6bc-65a6-469a-89a0-7e4c51620b14 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259648.2203515, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Resumed (Lifecycle Event)
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:34:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance spawned successfully.
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259648.2233534, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Started (Lifecycle Event)
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG nova.objects.instance [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82394) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 00:34:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:34:10 user nova-compute[82394]: INFO nova.compute.claims [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Claim successful on node user
Apr 12 00:34:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.479s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:34:11 user nova-compute[82394]: INFO nova.compute.claims [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Claim successful on node user
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:34:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.policy [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:34:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Creating image(s)
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "/opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "/opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:34:12 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.part --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.virt.images [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 1477c510-1b10-4162-b311-b1e0e3aeefda was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.part /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:34:12 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Creating image(s)
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG nova.policy [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.part /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.converted" returned: 0 in 0.268s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.215s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk 1073741824" returned: 0 in 0.052s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.762s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Cannot resize image /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'migration_context' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Ensure instance console log exists: /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json" returned: 0 in 0.209s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817,backing_fmt=raw /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817,backing_fmt=raw /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk 1073741824" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "04ece137a5e8b03dbf48afd8104cb6b9c713b817" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 --force-share --output=json" returned: 0 in 0.181s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.objects.instance [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'migration_context' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Ensure instance console log exists: /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Successfully created port: f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:34:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Successfully created port: a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Successfully updated port: f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquired lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-changed-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing instance network info cache due to event network-changed-f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Acquiring lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Successfully updated port: a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquired lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating instance_info_cache with network_info: [{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Releasing lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Instance network_info: |[{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Acquired lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing network info cache for port f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Start _get_guest_xml network_info=[{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7ff00f9b2a0292f2d51e61d28a63119f',container_format='bare',created_at=2023-04-12T00:33:59Z,direct_url=<?>,disk_format='qcow2',id=1477c510-1b10-4162-b311-b1e0e3aeefda,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244647299',owner='ca0ea21a2d4d400cba79444c68b58aed',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T00:34:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '1477c510-1b10-4162-b311-b1e0e3aeefda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:34:16 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:16 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7ff00f9b2a0292f2d51e61d28a63119f',container_format='bare',created_at=2023-04-12T00:33:59Z,direct_url=<?>,disk_format='qcow2',id=1477c510-1b10-4162-b311-b1e0e3aeefda,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244647299',owner='ca0ea21a2d4d400cba79444c68b58aed',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T00:34:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1092112857',display_name='tempest-TestStampPattern-server-1092112857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1092112857',id=17,image_ref='1477c510-1b10-4162-b311-b1e0e3aeefda',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-tfsp4ml4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d25bc2e7-3399-47be-b78d-990acbb51749',image_min_disk='1',image_min_ram='0',image_owner_id='ca0ea21a2d4d400cba79444c68b58aed',image_owner_project_name='tempest-TestStampPattern-628358733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-628358733-project-member',image_user_id='0e843a45549943cb88b1b3123a2fbe8a',network_allocated='True',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:11Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=6c1ae397-d28d-4143-9aa1-cf00e799f9b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:34:16 user nova-compute[82394]:   <uuid>6c1ae397-d28d-4143-9aa1-cf00e799f9b5</uuid>
Apr 12 00:34:16 user nova-compute[82394]:   <name>instance-00000011</name>
Apr 12 00:34:16 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:34:16 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:34:16 user nova-compute[82394]:   <metadata>
Apr 12 00:34:16 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:34:16 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:name>tempest-TestStampPattern-server-1092112857</nova:name>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:34:16</nova:creationTime>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:34:16 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:34:16 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:owner>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:user uuid="0e843a45549943cb88b1b3123a2fbe8a">tempest-TestStampPattern-628358733-project-member</nova:user>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:project uuid="ca0ea21a2d4d400cba79444c68b58aed">tempest-TestStampPattern-628358733</nova:project>
Apr 12 00:34:16 user nova-compute[82394]:       </nova:owner>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:root type="image" uuid="1477c510-1b10-4162-b311-b1e0e3aeefda"/>
Apr 12 00:34:16 user nova-compute[82394]:       <nova:ports>
Apr 12 00:34:16 user nova-compute[82394]:         <nova:port uuid="f0e98861-35b6-489e-9f17-463054e69601">
Apr 12 00:34:16 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 00:34:16 user nova-compute[82394]:         </nova:port>
Apr 12 00:34:16 user nova-compute[82394]:       </nova:ports>
Apr 12 00:34:16 user nova-compute[82394]:     </nova:instance>
Apr 12 00:34:16 user nova-compute[82394]:   </metadata>
Apr 12 00:34:16 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:34:16 user nova-compute[82394]:     <system>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="serial">6c1ae397-d28d-4143-9aa1-cf00e799f9b5</entry>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="uuid">6c1ae397-d28d-4143-9aa1-cf00e799f9b5</entry>
Apr 12 00:34:16 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:34:16 user nova-compute[82394]:     </system>
Apr 12 00:34:16 user nova-compute[82394]:   </sysinfo>
Apr 12 00:34:16 user nova-compute[82394]:   <os>
Apr 12 00:34:16 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:34:16 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:34:16 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:34:16 user nova-compute[82394]:   </os>
Apr 12 00:34:16 user nova-compute[82394]:   <features>
Apr 12 00:34:16 user nova-compute[82394]:     <acpi/>
Apr 12 00:34:16 user nova-compute[82394]:     <apic/>
Apr 12 00:34:16 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:34:16 user nova-compute[82394]:   </features>
Apr 12 00:34:16 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:34:16 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:34:16 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:34:16 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:34:16 user nova-compute[82394]:   </clock>
Apr 12 00:34:16 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:34:16 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:34:16 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:34:16 user nova-compute[82394]:   </cpu>
Apr 12 00:34:16 user nova-compute[82394]:   <devices>
Apr 12 00:34:16 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:16 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:16 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk"/>
Apr 12 00:34:16 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:34:16 user nova-compute[82394]:     </disk>
Apr 12 00:34:16 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:34:16 user nova-compute[82394]:       <mac address="fa:16:3e:6a:a6:53"/>
Apr 12 00:34:16 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:16 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:34:16 user nova-compute[82394]:       <target dev="tapf0e98861-35"/>
Apr 12 00:34:16 user nova-compute[82394]:     </interface>
Apr 12 00:34:16 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:34:16 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/console.log" append="off"/>
Apr 12 00:34:16 user nova-compute[82394]:     </serial>
Apr 12 00:34:16 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:34:16 user nova-compute[82394]:     <video>
Apr 12 00:34:16 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:16 user nova-compute[82394]:     </video>
Apr 12 00:34:16 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:34:16 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:34:16 user nova-compute[82394]:     </rng>
Apr 12 00:34:16 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:34:16 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:34:16 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:34:16 user nova-compute[82394]:     </memballoon>
Apr 12 00:34:16 user nova-compute[82394]:   </devices>
Apr 12 00:34:16 user nova-compute[82394]: </domain>
Apr 12 00:34:16 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1092112857',display_name='tempest-TestStampPattern-server-1092112857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1092112857',id=17,image_ref='1477c510-1b10-4162-b311-b1e0e3aeefda',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-tfsp4ml4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d25bc2e7-3399-47be-b78d-990acbb51749',image_min_disk='1',image_min_ram='0',image_owner_id='ca0ea21a2d4d400cba79444c68b58aed',image_owner_project_name='tempest-TestStampPattern-628358733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-628358733-project-member',image_user_id='0e843a45549943cb88b1b3123a2fbe8a',network_allocated='True',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:11Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=6c1ae397-d28d-4143-9aa1-cf00e799f9b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG os_vif [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0e98861-35, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0e98861-35, col_values=(('external_ids', {'iface-id': 'f0e98861-35b6-489e-9f17-463054e69601', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:a6:53', 'vm-uuid': '6c1ae397-d28d-4143-9aa1-cf00e799f9b5'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:16 user nova-compute[82394]: INFO os_vif [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35')
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No VIF found with MAC fa:16:3e:6a:a6:53, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updating instance_info_cache with network_info: [{"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Releasing lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Instance network_info: |[{"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Start _get_guest_xml network_info=[{"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:34:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467071576',display_name='tempest-AttachVolumeNegativeTest-server-1467071576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467071576',id=18,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIysUobFmc9X5YdnMYwlIEcSJnigDvHGxIpk+TP1afUFzLWmVglTO+snpoAKu69KheIwgjwoZA4vqNtG3U+76qhSJXgwg/N8/c0zXljFc8EJZe2wiop3pLQC7bMyegVYkg==',key_name='tempest-keypair-1703783656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-g9yjwtn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=2bae2f38-fd5e-4d51-be63-22bbf54cd77a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:34:17 user nova-compute[82394]:   <uuid>2bae2f38-fd5e-4d51-be63-22bbf54cd77a</uuid>
Apr 12 00:34:17 user nova-compute[82394]:   <name>instance-00000012</name>
Apr 12 00:34:17 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:34:17 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:34:17 user nova-compute[82394]:   <metadata>
Apr 12 00:34:17 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:34:17 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1467071576</nova:name>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:34:17</nova:creationTime>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:34:17 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:34:17 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:owner>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:user uuid="d373f582479c441e8ce9849ca694a186">tempest-AttachVolumeNegativeTest-2076679017-project-member</nova:user>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:project uuid="b56f3c567dc84773a33d596920df727a">tempest-AttachVolumeNegativeTest-2076679017</nova:project>
Apr 12 00:34:17 user nova-compute[82394]:       </nova:owner>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:34:17 user nova-compute[82394]:       <nova:ports>
Apr 12 00:34:17 user nova-compute[82394]:         <nova:port uuid="a152413c-fa33-4f4e-8c91-2b8a8c5565b6">
Apr 12 00:34:17 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 00:34:17 user nova-compute[82394]:         </nova:port>
Apr 12 00:34:17 user nova-compute[82394]:       </nova:ports>
Apr 12 00:34:17 user nova-compute[82394]:     </nova:instance>
Apr 12 00:34:17 user nova-compute[82394]:   </metadata>
Apr 12 00:34:17 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:34:17 user nova-compute[82394]:     <system>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="serial">2bae2f38-fd5e-4d51-be63-22bbf54cd77a</entry>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="uuid">2bae2f38-fd5e-4d51-be63-22bbf54cd77a</entry>
Apr 12 00:34:17 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:34:17 user nova-compute[82394]:     </system>
Apr 12 00:34:17 user nova-compute[82394]:   </sysinfo>
Apr 12 00:34:17 user nova-compute[82394]:   <os>
Apr 12 00:34:17 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:34:17 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:34:17 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:34:17 user nova-compute[82394]:   </os>
Apr 12 00:34:17 user nova-compute[82394]:   <features>
Apr 12 00:34:17 user nova-compute[82394]:     <acpi/>
Apr 12 00:34:17 user nova-compute[82394]:     <apic/>
Apr 12 00:34:17 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:34:17 user nova-compute[82394]:   </features>
Apr 12 00:34:17 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:34:17 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:34:17 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:34:17 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:34:17 user nova-compute[82394]:   </clock>
Apr 12 00:34:17 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:34:17 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:34:17 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:34:17 user nova-compute[82394]:   </cpu>
Apr 12 00:34:17 user nova-compute[82394]:   <devices>
Apr 12 00:34:17 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:17 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:17 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk"/>
Apr 12 00:34:17 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:34:17 user nova-compute[82394]:     </disk>
Apr 12 00:34:17 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:34:17 user nova-compute[82394]:       <mac address="fa:16:3e:4e:19:52"/>
Apr 12 00:34:17 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:17 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:34:17 user nova-compute[82394]:       <target dev="tapa152413c-fa"/>
Apr 12 00:34:17 user nova-compute[82394]:     </interface>
Apr 12 00:34:17 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:34:17 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/console.log" append="off"/>
Apr 12 00:34:17 user nova-compute[82394]:     </serial>
Apr 12 00:34:17 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:34:17 user nova-compute[82394]:     <video>
Apr 12 00:34:17 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:17 user nova-compute[82394]:     </video>
Apr 12 00:34:17 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:34:17 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:34:17 user nova-compute[82394]:     </rng>
Apr 12 00:34:17 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:34:17 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:34:17 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:34:17 user nova-compute[82394]:     </memballoon>
Apr 12 00:34:17 user nova-compute[82394]:   </devices>
Apr 12 00:34:17 user nova-compute[82394]: </domain>
Apr 12 00:34:17 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467071576',display_name='tempest-AttachVolumeNegativeTest-server-1467071576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467071576',id=18,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIysUobFmc9X5YdnMYwlIEcSJnigDvHGxIpk+TP1afUFzLWmVglTO+snpoAKu69KheIwgjwoZA4vqNtG3U+76qhSJXgwg/N8/c0zXljFc8EJZe2wiop3pLQC7bMyegVYkg==',key_name='tempest-keypair-1703783656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-g9yjwtn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=2bae2f38-fd5e-4d51-be63-22bbf54cd77a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG os_vif [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa152413c-fa, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa152413c-fa, col_values=(('external_ids', {'iface-id': 'a152413c-fa33-4f4e-8c91-2b8a8c5565b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:19:52', 'vm-uuid': '2bae2f38-fd5e-4d51-be63-22bbf54cd77a'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updated VIF entry in instance network info cache for port f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating instance_info_cache with network_info: [{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:17 user nova-compute[82394]: INFO os_vif [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa')
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Releasing lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:4e:19:52, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-changed-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Refreshing instance network info cache due to event network-changed-a152413c-fa33-4f4e-8c91-2b8a8c5565b6. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Acquiring lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Acquired lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Refreshing network info cache for port a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:34:17 user nova-compute[82394]: INFO nova.compute.claims [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Claim successful on node user
Apr 12 00:34:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updated VIF entry in instance network info cache for port a152413c-fa33-4f4e-8c91-2b8a8c5565b6. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updating instance_info_cache with network_info: [{"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Releasing lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] No waiting events found dispatching network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:18 user nova-compute[82394]: WARNING nova.compute.manager [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received unexpected event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 for instance with vm_state building and task_state spawning.
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:34:18 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:34:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.policy [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6d875a6e14446469a8a58b97a0e89d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48be6d35ad6c43c8b048811baffb8da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:34:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Creating image(s)
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "/opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "/opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk 1073741824" returned: 0 in 0.056s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Cannot resize image /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lazy-loading 'migration_context' on Instance uuid 1b203e2e-a2ba-4989-94bc-2a78491a9b89 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Ensure instance console log exists: /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Successfully created port: 857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:20 user nova-compute[82394]: INFO nova.compute.manager [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attaching volume e216a462-956b-4e02-b6d1-98de85ad7929 to /dev/vdb
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.utils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5042f1-e834-4344-b755-319783c2962b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa85c3-ae71-4439-a4fa-c29079122b9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c810188-ac41-461f-9412-2b2d67aba515]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d83de-2827-48ad-ada5-42a9a255e547]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] No waiting events found dispatching network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:20 user nova-compute[82394]: WARNING nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received unexpected event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 for instance with vm_state building and task_state spawning.
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] No waiting events found dispatching network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:20 user nova-compute[82394]: WARNING nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received unexpected event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance with vm_state building and task_state spawning.
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] No waiting events found dispatching network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:20 user nova-compute[82394]: WARNING nova.compute.manager [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received unexpected event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance with vm_state building and task_state spawning.
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:34:20 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f4d64-dc8c-44b2-a901-88ee3a223b85]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG os_brick.utils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating existing volume attachment record: 79ab695e-b3c9-4a01-a370-55dc8bc5a801 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Successfully updated port: 857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquired lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-changed-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Refreshing instance network info cache due to event network-changed-857280d0-efc9-4f7f-988a-ca07d7d5f957. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Acquiring lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Updating instance_info_cache with network_info: [{"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Releasing lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Instance network_info: |[{"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Acquired lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Refreshing network info cache for port 857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Start _get_guest_xml network_info=[{"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:34:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1849840891',display_name='tempest-VolumesActionsTest-instance-1849840891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1849840891',id=19,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48be6d35ad6c43c8b048811baffb8da8',ramdisk_id='',reservation_id='r-rkmgedqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-69590984',owner_user_name='tempest-VolumesActionsTest-69590984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:19Z,user_data=None,user_id='f6d875a6e14446469a8a58b97a0e89d4',uuid=1b203e2e-a2ba-4989-94bc-2a78491a9b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converting VIF {"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b203e2e-a2ba-4989-94bc-2a78491a9b89 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:34:21 user nova-compute[82394]:   <uuid>1b203e2e-a2ba-4989-94bc-2a78491a9b89</uuid>
Apr 12 00:34:21 user nova-compute[82394]:   <name>instance-00000013</name>
Apr 12 00:34:21 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:34:21 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:34:21 user nova-compute[82394]:   <metadata>
Apr 12 00:34:21 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:34:21 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:name>tempest-VolumesActionsTest-instance-1849840891</nova:name>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:34:21</nova:creationTime>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:34:21 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:34:21 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:owner>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:user uuid="f6d875a6e14446469a8a58b97a0e89d4">tempest-VolumesActionsTest-69590984-project-member</nova:user>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:project uuid="48be6d35ad6c43c8b048811baffb8da8">tempest-VolumesActionsTest-69590984</nova:project>
Apr 12 00:34:21 user nova-compute[82394]:       </nova:owner>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:34:21 user nova-compute[82394]:       <nova:ports>
Apr 12 00:34:21 user nova-compute[82394]:         <nova:port uuid="857280d0-efc9-4f7f-988a-ca07d7d5f957">
Apr 12 00:34:21 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:34:21 user nova-compute[82394]:         </nova:port>
Apr 12 00:34:21 user nova-compute[82394]:       </nova:ports>
Apr 12 00:34:21 user nova-compute[82394]:     </nova:instance>
Apr 12 00:34:21 user nova-compute[82394]:   </metadata>
Apr 12 00:34:21 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:34:21 user nova-compute[82394]:     <system>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="serial">1b203e2e-a2ba-4989-94bc-2a78491a9b89</entry>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="uuid">1b203e2e-a2ba-4989-94bc-2a78491a9b89</entry>
Apr 12 00:34:21 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:34:21 user nova-compute[82394]:     </system>
Apr 12 00:34:21 user nova-compute[82394]:   </sysinfo>
Apr 12 00:34:21 user nova-compute[82394]:   <os>
Apr 12 00:34:21 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:34:21 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:34:21 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:34:21 user nova-compute[82394]:   </os>
Apr 12 00:34:21 user nova-compute[82394]:   <features>
Apr 12 00:34:21 user nova-compute[82394]:     <acpi/>
Apr 12 00:34:21 user nova-compute[82394]:     <apic/>
Apr 12 00:34:21 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:34:21 user nova-compute[82394]:   </features>
Apr 12 00:34:21 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:34:21 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:34:21 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:34:21 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:34:21 user nova-compute[82394]:   </clock>
Apr 12 00:34:21 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:34:21 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:34:21 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:34:21 user nova-compute[82394]:   </cpu>
Apr 12 00:34:21 user nova-compute[82394]:   <devices>
Apr 12 00:34:21 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:21 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:21 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk"/>
Apr 12 00:34:21 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:34:21 user nova-compute[82394]:     </disk>
Apr 12 00:34:21 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:34:21 user nova-compute[82394]:       <mac address="fa:16:3e:c7:d6:9a"/>
Apr 12 00:34:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:21 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:34:21 user nova-compute[82394]:       <target dev="tap857280d0-ef"/>
Apr 12 00:34:21 user nova-compute[82394]:     </interface>
Apr 12 00:34:21 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:34:21 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/console.log" append="off"/>
Apr 12 00:34:21 user nova-compute[82394]:     </serial>
Apr 12 00:34:21 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:34:21 user nova-compute[82394]:     <video>
Apr 12 00:34:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:21 user nova-compute[82394]:     </video>
Apr 12 00:34:21 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:34:21 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:34:21 user nova-compute[82394]:     </rng>
Apr 12 00:34:21 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:34:21 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:34:21 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:34:21 user nova-compute[82394]:     </memballoon>
Apr 12 00:34:21 user nova-compute[82394]:   </devices>
Apr 12 00:34:21 user nova-compute[82394]: </domain>
Apr 12 00:34:21 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1849840891',display_name='tempest-VolumesActionsTest-instance-1849840891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1849840891',id=19,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48be6d35ad6c43c8b048811baffb8da8',ramdisk_id='',reservation_id='r-rkmgedqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-69590984',owner_user_name='tempest-VolumesActionsTest-69590984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:34:19Z,user_data=None,user_id='f6d875a6e14446469a8a58b97a0e89d4',uuid=1b203e2e-a2ba-4989-94bc-2a78491a9b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converting VIF {"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG os_vif [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap857280d0-ef, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap857280d0-ef, col_values=(('external_ids', {'iface-id': '857280d0-efc9-4f7f-988a-ca07d7d5f957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:d6:9a', 'vm-uuid': '1b203e2e-a2ba-4989-94bc-2a78491a9b89'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:21 user nova-compute[82394]: INFO os_vif [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef')
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] No VIF found with MAC fa:16:3e:c7:d6:9a, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Updated VIF entry in instance network info cache for port 857280d0-efc9-4f7f-988a-ca07d7d5f957. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Updating instance_info_cache with network_info: [{"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Releasing lock "refresh_cache-1b203e2e-a2ba-4989-94bc-2a78491a9b89" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259662.2614207, 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] VM Resumed (Lifecycle Event)
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Instance spawned successfully.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259662.27892, 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] VM Started (Lifecycle Event)
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Took 10.94 seconds to spawn the instance on the hypervisor.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Took 12.04 seconds to build instance.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.217s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259662.570969, 2bae2f38-fd5e-4d51-be63-22bbf54cd77a => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] VM Resumed (Lifecycle Event)
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Instance spawned successfully.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259662.5711966, 2bae2f38-fd5e-4d51-be63-22bbf54cd77a => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] VM Started (Lifecycle Event)
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Took 9.94 seconds to spawn the instance on the hypervisor.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:22 user nova-compute[82394]: INFO nova.compute.manager [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Took 12.29 seconds to build instance.
Apr 12 00:34:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.429s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] No waiting events found dispatching network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:23 user nova-compute[82394]: WARNING nova.compute.manager [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received unexpected event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance with vm_state building and task_state spawning.
Apr 12 00:34:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] No waiting events found dispatching network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:25 user nova-compute[82394]: WARNING nova.compute.manager [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received unexpected event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance with vm_state building and task_state spawning.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqlNOWQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:34:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:34:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:34:26 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a671887f-18db-4d83-b456-8ba25ab0cb73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:34:26 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3645242-d717-4c10-9cbe-9fd080e87206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929] added
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259666.1960263, 1b203e2e-a2ba-4989-94bc-2a78491a9b89 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] VM Resumed (Lifecycle Event)
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e8f70-a61b-4c7e-bcea-d913196f31be]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Instance spawned successfully.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a102df7-9786-4782-8d39-132607a89946]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqlNOWQo {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqlNOWQo" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2de6fc-8e93-4c88-b4d8-125faa4d632b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqlNOWQo'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259666.200216, 1b203e2e-a2ba-4989-94bc-2a78491a9b89 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] VM Started (Lifecycle Event)
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5834fcc-abdf-4d45-901a-5c8bb29f9ede]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41606f7-f6c5-4dad-acdb-d1e339246757]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Took 7.26 seconds to spawn the instance on the hypervisor.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68c613-aac0-4fca-a228-af8867694fa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260]
Apr 12 00:34:26 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260] successful.
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5946f-8472-496c-b61f-9910880de3af]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Took 8.65 seconds to build instance.
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac519c1-eabc-45d1-bf98-f3ec5d7852a0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)
Apr 12 00:34:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.804s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c481b521-0361-48ee-b431-65b3d446ab02]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:34:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqlNOWQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:34:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:34:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23662363465613965', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:34:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662363465613965', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:34:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:34:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:34:27 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:34:27 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:34:27 user nova-compute[82394]:   <serial>e216a462-956b-4e02-b6d1-98de85ad7929</serial>
Apr 12 00:34:27 user nova-compute[82394]: </disk>
Apr 12 00:34:27 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No VIF found with MAC fa:16:3e:ad:aa:95, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.834s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:30 user nova-compute[82394]: INFO nova.compute.manager [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Detaching volume e216a462-956b-4e02-b6d1-98de85ad7929
Apr 12 00:34:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:30 user nova-compute[82394]: INFO nova.virt.block_device [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attempting to driver detach volume e216a462-956b-4e02-b6d1-98de85ad7929 from mountpoint /dev/vdb
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Attempting to detach device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:34:30 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:34:30 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:34:30 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:34:30 user nova-compute[82394]:   <serial>e216a462-956b-4e02-b6d1-98de85ad7929</serial>
Apr 12 00:34:30 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:34:30 user nova-compute[82394]: </disk>
Apr 12 00:34:30 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:34:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config.
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:34:30 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:34:30 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:34:30 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:34:30 user nova-compute[82394]:   <serial>e216a462-956b-4e02-b6d1-98de85ad7929</serial>
Apr 12 00:34:30 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:34:30 user nova-compute[82394]: </disk>
Apr 12 00:34:30 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259670.7341888, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:34:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config.
Apr 12 00:34:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqlNOWQo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:34:30 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee621091-2747-4923-bb10-b8d99b33c361]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:34:30 user nova-compute[82394]: No targets found.
Apr 12 00:34:30 user nova-compute[82394]: iSNS:
Apr 12 00:34:30 user nova-compute[82394]: No targets found.
Apr 12 00:34:30 user nova-compute[82394]: STATIC:
Apr 12 00:34:30 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:34:30 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:34:30 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:34:30 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:34:30 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:34:30 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:34:30 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929
Apr 12 00:34:30 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:34:30 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:34:30 user nova-compute[82394]: FIRMWARE:
Apr 12 00:34:30 user nova-compute[82394]: No targets found.
Apr 12 00:34:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:34:30 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:34:30 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ace37-72d6-489a-8bf8-21fd78bbbc21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed69517-ea5e-42f2-8891-285a93371db7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:30 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:30 user nova-compute[82394]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)
Apr 12 00:34:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:34:30 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:34:30 user nova-compute[82394]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 (non-flash)
Apr 12 00:34:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347d30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48fddcf-d5d2-4762-8df5-b4f5a781f599]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7e063-756f-4329-a7d5-91dea8cb442f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e6c6f-9686-4a8e-9fb1-37f206b74287]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914a060-8403-4ef3-81c2-f951498a5b18]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[303480a6-ba3a-4782-9952-a6639ba736c6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa630b2d-ccb0-494d-9af8-a917a3594736]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260]
Apr 12 00:34:31 user nova-compute[82394]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929, portal: 172.16.0.220,3260] successful.
Apr 12 00:34:31 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e216a462-956b-4e02-b6d1-98de85ad7929 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e72d325-67f4-485a-a055-13d19cafe611]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== disconnect_volume: return (410ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:34:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:32 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.078s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:33 user nova-compute[82394]: INFO nova.compute.manager [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Rescuing
Apr 12 00:34:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:34:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:34:33 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:34:34 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:34:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:34:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:35 user nova-compute[82394]: WARNING nova.compute.manager [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state active and task_state rescuing.
Apr 12 00:34:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance destroyed successfully.
Apr 12 00:34:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Attempting rescue
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:34:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Creating image(s)
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue" returned: 0 in 0.058s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start _get_guest_xml network_info=[{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ac:e7:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254044738',display_name='tempest-ServerRescueNegativeTestJSON-server-254044738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254044738',id=2,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-0lxmmwfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:30:02Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=8d895d64-319f-4c67-8c20-ef0d0437a1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ac:e7:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ac:e7:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:34:35 user nova-compute[82394]:   <uuid>8d895d64-319f-4c67-8c20-ef0d0437a1f0</uuid>
Apr 12 00:34:35 user nova-compute[82394]:   <name>instance-00000002</name>
Apr 12 00:34:35 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:34:35 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:34:35 user nova-compute[82394]:   <metadata>
Apr 12 00:34:35 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:34:35 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-254044738</nova:name>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:34:35</nova:creationTime>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:34:35 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:34:35 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:owner>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:34:35 user nova-compute[82394]:       </nova:owner>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:34:35 user nova-compute[82394]:       <nova:ports>
Apr 12 00:34:35 user nova-compute[82394]:         <nova:port uuid="e92d06cb-6535-4389-b328-57add5f4f812">
Apr 12 00:34:35 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:34:35 user nova-compute[82394]:         </nova:port>
Apr 12 00:34:35 user nova-compute[82394]:       </nova:ports>
Apr 12 00:34:35 user nova-compute[82394]:     </nova:instance>
Apr 12 00:34:35 user nova-compute[82394]:   </metadata>
Apr 12 00:34:35 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:34:35 user nova-compute[82394]:     <system>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="serial">8d895d64-319f-4c67-8c20-ef0d0437a1f0</entry>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="uuid">8d895d64-319f-4c67-8c20-ef0d0437a1f0</entry>
Apr 12 00:34:35 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:34:35 user nova-compute[82394]:     </system>
Apr 12 00:34:35 user nova-compute[82394]:   </sysinfo>
Apr 12 00:34:35 user nova-compute[82394]:   <os>
Apr 12 00:34:35 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:34:35 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:34:35 user nova-compute[82394]:   </os>
Apr 12 00:34:35 user nova-compute[82394]:   <features>
Apr 12 00:34:35 user nova-compute[82394]:     <acpi/>
Apr 12 00:34:35 user nova-compute[82394]:     <apic/>
Apr 12 00:34:35 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:34:35 user nova-compute[82394]:   </features>
Apr 12 00:34:35 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:34:35 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:34:35 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:34:35 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:34:35 user nova-compute[82394]:   </clock>
Apr 12 00:34:35 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:34:35 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:34:35 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:34:35 user nova-compute[82394]:   </cpu>
Apr 12 00:34:35 user nova-compute[82394]:   <devices>
Apr 12 00:34:35 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:35 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:35 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue"/>
Apr 12 00:34:35 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:34:35 user nova-compute[82394]:     </disk>
Apr 12 00:34:35 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:34:35 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:34:35 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk"/>
Apr 12 00:34:35 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:34:35 user nova-compute[82394]:     </disk>
Apr 12 00:34:35 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:34:35 user nova-compute[82394]:       <mac address="fa:16:3e:ac:e7:ce"/>
Apr 12 00:34:35 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:35 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:34:35 user nova-compute[82394]:       <target dev="tape92d06cb-65"/>
Apr 12 00:34:35 user nova-compute[82394]:     </interface>
Apr 12 00:34:35 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:34:35 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/console.log" append="off"/>
Apr 12 00:34:35 user nova-compute[82394]:     </serial>
Apr 12 00:34:35 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:34:35 user nova-compute[82394]:     <video>
Apr 12 00:34:35 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:34:35 user nova-compute[82394]:     </video>
Apr 12 00:34:35 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:34:35 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:34:35 user nova-compute[82394]:     </rng>
Apr 12 00:34:35 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:34:35 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:34:35 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:34:35 user nova-compute[82394]:     </memballoon>
Apr 12 00:34:35 user nova-compute[82394]:   </devices>
Apr 12 00:34:35 user nova-compute[82394]: </domain>
Apr 12 00:34:35 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:34:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance destroyed successfully.
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:34:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:ac:e7:ce, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:36 user nova-compute[82394]: WARNING nova.compute.manager [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state active and task_state rescuing.
Apr 12 00:34:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:38 user nova-compute[82394]: WARNING nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state active and task_state rescuing.
Apr 12 00:34:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:34:38 user nova-compute[82394]: WARNING nova.compute.manager [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state active and task_state rescuing.
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 8d895d64-319f-4c67-8c20-ef0d0437a1f0 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259679.495252, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Resumed (Lifecycle Event)
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259679.4967034, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:34:39 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Started (Lifecycle Event)
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:34:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:34:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:46 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:34:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:34:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:34:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7153MB free_disk=26.419166564941406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d8833bad-d30f-4cd4-aa66-10d60c782061 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:34:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:34:52 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:52 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:34:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:34:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:34:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:34:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:01 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:35:01 user nova-compute[82394]: INFO nova.compute.claims [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Claim successful on node user
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:35:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.policy [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:35:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Creating image(s)
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "/opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "/opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "/opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk 1073741824" returned: 0 in 0.047s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.127s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:35:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Cannot resize image /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'migration_context' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Successfully created port: 40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Ensure instance console log exists: /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Successfully updated port: 40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquired lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-changed-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Refreshing instance network info cache due to event network-changed-40e300fb-a2c9-4770-8eee-d1b48baedf34. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Acquiring lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updating instance_info_cache with network_info: [{"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Releasing lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Instance network_info: |[{"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Acquired lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.neutron [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Refreshing network info cache for port 40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Start _get_guest_xml network_info=[{"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:35:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-514180225',display_name='tempest-VolumesAdminNegativeTest-server-514180225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-514180225',id=20,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwrW/DiMlNF2Ji9Y5iVEQBZtMtRV6Vih4ujw06H39HRo0xW45aPYpYvBV2mUrxJyYo0WpGsoBY7+Fdvab4BKf8lv/2VL0+lT0QPJ8oA5k9l0pJvB0di4++LeVyMOVzPdg==',key_name='tempest-keypair-1911302712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-afvfpe08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c276268b63084515a43caa837af30fb1',uuid=88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'pci_devices' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:35:04 user nova-compute[82394]:   <uuid>88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3</uuid>
Apr 12 00:35:04 user nova-compute[82394]:   <name>instance-00000014</name>
Apr 12 00:35:04 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:35:04 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:35:04 user nova-compute[82394]:   <metadata>
Apr 12 00:35:04 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:35:04 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:name>tempest-VolumesAdminNegativeTest-server-514180225</nova:name>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:35:04</nova:creationTime>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:35:04 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:35:04 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:owner>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:user uuid="c276268b63084515a43caa837af30fb1">tempest-VolumesAdminNegativeTest-1593136751-project-member</nova:user>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:project uuid="a8c1003f0d1847b7b4c679b0f7cc3110">tempest-VolumesAdminNegativeTest-1593136751</nova:project>
Apr 12 00:35:04 user nova-compute[82394]:       </nova:owner>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:35:04 user nova-compute[82394]:       <nova:ports>
Apr 12 00:35:04 user nova-compute[82394]:         <nova:port uuid="40e300fb-a2c9-4770-8eee-d1b48baedf34">
Apr 12 00:35:04 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 00:35:04 user nova-compute[82394]:         </nova:port>
Apr 12 00:35:04 user nova-compute[82394]:       </nova:ports>
Apr 12 00:35:04 user nova-compute[82394]:     </nova:instance>
Apr 12 00:35:04 user nova-compute[82394]:   </metadata>
Apr 12 00:35:04 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:35:04 user nova-compute[82394]:     <system>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="serial">88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3</entry>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="uuid">88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3</entry>
Apr 12 00:35:04 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:35:04 user nova-compute[82394]:     </system>
Apr 12 00:35:04 user nova-compute[82394]:   </sysinfo>
Apr 12 00:35:04 user nova-compute[82394]:   <os>
Apr 12 00:35:04 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:35:04 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:35:04 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:35:04 user nova-compute[82394]:   </os>
Apr 12 00:35:04 user nova-compute[82394]:   <features>
Apr 12 00:35:04 user nova-compute[82394]:     <acpi/>
Apr 12 00:35:04 user nova-compute[82394]:     <apic/>
Apr 12 00:35:04 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:35:04 user nova-compute[82394]:   </features>
Apr 12 00:35:04 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:35:04 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:35:04 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:35:04 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:35:04 user nova-compute[82394]:   </clock>
Apr 12 00:35:04 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:35:04 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:35:04 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:35:04 user nova-compute[82394]:   </cpu>
Apr 12 00:35:04 user nova-compute[82394]:   <devices>
Apr 12 00:35:04 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:35:04 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:35:04 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk"/>
Apr 12 00:35:04 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:35:04 user nova-compute[82394]:     </disk>
Apr 12 00:35:04 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:35:04 user nova-compute[82394]:       <mac address="fa:16:3e:e8:3b:ed"/>
Apr 12 00:35:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:04 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:35:04 user nova-compute[82394]:       <target dev="tap40e300fb-a2"/>
Apr 12 00:35:04 user nova-compute[82394]:     </interface>
Apr 12 00:35:04 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:35:04 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/console.log" append="off"/>
Apr 12 00:35:04 user nova-compute[82394]:     </serial>
Apr 12 00:35:04 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:35:04 user nova-compute[82394]:     <video>
Apr 12 00:35:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:04 user nova-compute[82394]:     </video>
Apr 12 00:35:04 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:35:04 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:35:04 user nova-compute[82394]:     </rng>
Apr 12 00:35:04 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:35:04 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:35:04 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:35:04 user nova-compute[82394]:     </memballoon>
Apr 12 00:35:04 user nova-compute[82394]:   </devices>
Apr 12 00:35:04 user nova-compute[82394]: </domain>
Apr 12 00:35:04 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-514180225',display_name='tempest-VolumesAdminNegativeTest-server-514180225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-514180225',id=20,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwrW/DiMlNF2Ji9Y5iVEQBZtMtRV6Vih4ujw06H39HRo0xW45aPYpYvBV2mUrxJyYo0WpGsoBY7+Fdvab4BKf8lv/2VL0+lT0QPJ8oA5k9l0pJvB0di4++LeVyMOVzPdg==',key_name='tempest-keypair-1911302712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-afvfpe08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c276268b63084515a43caa837af30fb1',uuid=88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG os_vif [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40e300fb-a2, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40e300fb-a2, col_values=(('external_ids', {'iface-id': '40e300fb-a2c9-4770-8eee-d1b48baedf34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:3b:ed', 'vm-uuid': '88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:04 user nova-compute[82394]: INFO os_vif [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2')
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:35:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No VIF found with MAC fa:16:3e:e8:3b:ed, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:35:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updated VIF entry in instance network info cache for port 40e300fb-a2c9-4770-8eee-d1b48baedf34. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:35:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updating instance_info_cache with network_info: [{"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Releasing lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] No waiting events found dispatching network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:35:06 user nova-compute[82394]: WARNING nova.compute.manager [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received unexpected event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance with vm_state building and task_state spawning.
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259708.316033, 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] VM Resumed (Lifecycle Event)
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Instance spawned successfully.
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259708.318954, 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] VM Started (Lifecycle Event)
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] No waiting events found dispatching network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:35:08 user nova-compute[82394]: WARNING nova.compute.manager [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received unexpected event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance with vm_state active and task_state None.
Apr 12 00:35:08 user nova-compute[82394]: INFO nova.compute.manager [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Took 6.81 seconds to build instance.
Apr 12 00:35:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:12 user nova-compute[82394]: INFO nova.compute.manager [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Unshelving
Apr 12 00:35:12 user nova-compute[82394]: INFO nova.virt.block_device [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Booting with volume 8d0a089d-f950-4c30-a68f-7511646878fb at /dev/vda
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[273ebf93-5725-44f4-af6d-341632592197]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e23d46-1e36-444c-860a-1cef9478667b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[000db75d-7a18-44b4-b3d0-173d4939d650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[452904bf-428d-45cc-aa57-7074ca088ecd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:12 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:35:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2231530-af6a-40ab-99f0-4225645641f2]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:12 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating existing volume attachment record: 0b58ab12-9a54-4509-bc93-c4205fdfd9bf {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:35:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'pci_requests' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'numa_topology' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:35:17 user nova-compute[82394]: INFO nova.compute.claims [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Claim successful on node user
Apr 12 00:35:17 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:35:17 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:35:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:17 user nova-compute[82394]: INFO nova.network.neutron [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating port b796ef8b-d964-459f-b12c-9be0133dd643 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing instance network info cache due to event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:35:18 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Creating image(s)
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Ensure instance console log exists: /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start _get_guest_xml network_info=[{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b58ab12-9a54-4509-bc93-c4205fdfd9bf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19cc71e1-9b01-4bfd-9898-14b04bfe5fff', 'attached_at': '', 'detached_at': '', 'volume_id': '8d0a089d-f950-4c30-a68f-7511646878fb', 'serial': '8d0a089d-f950-4c30-a68f-7511646878fb'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:35:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:19 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9663417-7770-4650-acfd-b7b6c1b4a3b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:35:19 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[99030832-ae7f-4af8-ab1b-0940ea2beba0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb] added
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2171c3-4574-468b-88cc-b421547652fc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5905e5d-4019-40ca-9f47-0fbfc5aa1447]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEmcGxDg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEmcGxDg" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae369983-8ad9-4000-b475-5bf1e3ed763f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEmcGxDg'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4185900-6d44-4701-823e-43702165aeb0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086259b-5829-46de-8126-7a9b440a22a8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bc4084-0954-4d53-8f4c-b44460741f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]
Apr 12 00:35:19 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec67c3-dce7-4ead-908e-42d3b0f1b866]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a567a-362a-410a-abab-c95cb0b32960]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:19 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[08216553-3a05-4b63-9eb9-f45e5c10101e]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updated VIF entry in instance network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23437343265363431', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437343265363431', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-382306594',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:35:12Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'pci_devices' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:35:20 user nova-compute[82394]:   <uuid>19cc71e1-9b01-4bfd-9898-14b04bfe5fff</uuid>
Apr 12 00:35:20 user nova-compute[82394]:   <name>instance-0000000d</name>
Apr 12 00:35:20 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:35:20 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:35:20 user nova-compute[82394]:   <metadata>
Apr 12 00:35:20 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:35:20 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:35:20 user nova-compute[82394]:       <nova:name>tempest-TestShelveInstance-server-1609521830</nova:name>
Apr 12 00:35:20 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:35:19</nova:creationTime>
Apr 12 00:35:20 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:35:20 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:35:20 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:35:20 user nova-compute[82394]:       <nova:owner>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:user uuid="391e2cd0c34b4e838c4cf86ba933270c">tempest-TestShelveInstance-431446894-project-member</nova:user>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:project uuid="b7bc7149e49343889c32fc198b6a0500">tempest-TestShelveInstance-431446894</nova:project>
Apr 12 00:35:20 user nova-compute[82394]:       </nova:owner>
Apr 12 00:35:20 user nova-compute[82394]:       <nova:ports>
Apr 12 00:35:20 user nova-compute[82394]:         <nova:port uuid="b796ef8b-d964-459f-b12c-9be0133dd643">
Apr 12 00:35:20 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:35:20 user nova-compute[82394]:         </nova:port>
Apr 12 00:35:20 user nova-compute[82394]:       </nova:ports>
Apr 12 00:35:20 user nova-compute[82394]:     </nova:instance>
Apr 12 00:35:20 user nova-compute[82394]:   </metadata>
Apr 12 00:35:20 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:35:20 user nova-compute[82394]:     <system>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="serial">19cc71e1-9b01-4bfd-9898-14b04bfe5fff</entry>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="uuid">19cc71e1-9b01-4bfd-9898-14b04bfe5fff</entry>
Apr 12 00:35:20 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:35:20 user nova-compute[82394]:     </system>
Apr 12 00:35:20 user nova-compute[82394]:   </sysinfo>
Apr 12 00:35:20 user nova-compute[82394]:   <os>
Apr 12 00:35:20 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:35:20 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:35:20 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:35:20 user nova-compute[82394]:   </os>
Apr 12 00:35:20 user nova-compute[82394]:   <features>
Apr 12 00:35:20 user nova-compute[82394]:     <acpi/>
Apr 12 00:35:20 user nova-compute[82394]:     <apic/>
Apr 12 00:35:20 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:35:20 user nova-compute[82394]:   </features>
Apr 12 00:35:20 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:35:20 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:35:20 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:35:20 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:35:20 user nova-compute[82394]:   </clock>
Apr 12 00:35:20 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:35:20 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:35:20 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:35:20 user nova-compute[82394]:   </cpu>
Apr 12 00:35:20 user nova-compute[82394]:   <devices>
Apr 12 00:35:20 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:35:20 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:35:20 user nova-compute[82394]:       <source dev="/dev/sdd"/>
Apr 12 00:35:20 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:35:20 user nova-compute[82394]:       <serial>8d0a089d-f950-4c30-a68f-7511646878fb</serial>
Apr 12 00:35:20 user nova-compute[82394]:     </disk>
Apr 12 00:35:20 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:35:20 user nova-compute[82394]:       <mac address="fa:16:3e:7e:89:9d"/>
Apr 12 00:35:20 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:20 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:35:20 user nova-compute[82394]:       <target dev="tapb796ef8b-d9"/>
Apr 12 00:35:20 user nova-compute[82394]:     </interface>
Apr 12 00:35:20 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:35:20 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/console.log" append="off"/>
Apr 12 00:35:20 user nova-compute[82394]:     </serial>
Apr 12 00:35:20 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:35:20 user nova-compute[82394]:     <video>
Apr 12 00:35:20 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:20 user nova-compute[82394]:     </video>
Apr 12 00:35:20 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:35:20 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:35:20 user nova-compute[82394]:     </rng>
Apr 12 00:35:20 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:35:20 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:35:20 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:35:20 user nova-compute[82394]:     </memballoon>
Apr 12 00:35:20 user nova-compute[82394]:   </devices>
Apr 12 00:35:20 user nova-compute[82394]: </domain>
Apr 12 00:35:20 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-382306594',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:35:12Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG os_vif [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb796ef8b-d9, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb796ef8b-d9, col_values=(('external_ids', {'iface-id': 'b796ef8b-d964-459f-b12c-9be0133dd643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:89:9d', 'vm-uuid': '19cc71e1-9b01-4bfd-9898-14b04bfe5fff'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:20 user nova-compute[82394]: INFO os_vif [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9')
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:35:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] No VIF found with MAC fa:16:3e:7e:89:9d, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:35:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:35:22 user nova-compute[82394]: WARNING nova.compute.manager [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:35:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:23 user nova-compute[82394]: INFO nova.compute.manager [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attaching volume 5b251160-965f-41ea-9dae-a97c44d4a1db to /dev/vdb
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.utils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e75e475-45a3-4929-a8e8-3bcf703a0509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9b79a-27c6-4a42-8300-73609b8d11bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae06af3d-f509-4198-ae10-fca7ca63180e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc2f8f1-ed2e-4f15-9d09-38c78d984cb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:23 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:35:23 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1129eb21-3e57-42b2-95e0-5754140af414]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG os_brick.utils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:23 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating existing volume attachment record: 9af71c4b-ad90-4fab-93cf-43ce179330cc {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:35:24 user nova-compute[82394]: WARNING nova.compute.manager [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259724.4831662, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:35:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Resumed (Lifecycle Event)
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:35:24 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance spawned successfully.
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:35:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259724.4880452, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:35:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Started (Lifecycle Event)
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:35:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.226s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJNDmZhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:28 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6be54-86eb-4aa9-be1a-11f37a92814b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:35:28 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2433f81c-08a7-4a4e-b2cd-2a17a979fe10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db] added
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916ccf4-cfb4-4b41-a9ad-a878c156133c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe952bdb-e8df-498f-80bc-980080384c30]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJNDmZhT {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJNDmZhT" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd2e4f-693e-46b0-a6dd-fc90ff335536]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nJNDmZhT'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[222d27f3-70fc-450f-808b-49ca9d4a7771]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4ebf8-d09f-40ea-a98e-c14d0c266e55]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[799082e7-c966-4ef1-a5d1-64e51f7213fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260]
Apr 12 00:35:28 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260] successful.
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd20ee6-03a2-4f2a-8139-af7e36e73df4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb9f7eb-28c8-4f5a-b10c-926f6f6b43ef]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:28 user nova-compute[82394]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)
Apr 12 00:35:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5341197f-a8ce-4012-9a5e-ee93bad83520]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:35:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJNDmZhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:35:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26530643530393564', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530643530393564', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:35:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:35:29 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:35:29 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:35:29 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:35:29 user nova-compute[82394]:   <serial>5b251160-965f-41ea-9dae-a97c44d4a1db</serial>
Apr 12 00:35:29 user nova-compute[82394]: </disk>
Apr 12 00:35:29 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No VIF found with MAC fa:16:3e:ad:aa:95, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.771s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:31 user nova-compute[82394]: INFO nova.compute.manager [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Detaching volume 5b251160-965f-41ea-9dae-a97c44d4a1db
Apr 12 00:35:31 user nova-compute[82394]: INFO nova.virt.block_device [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attempting to driver detach volume 5b251160-965f-41ea-9dae-a97c44d4a1db from mountpoint /dev/vdb
Apr 12 00:35:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Attempting to detach device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:35:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:35:31 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:35:31 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:35:31 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:35:31 user nova-compute[82394]:   <serial>5b251160-965f-41ea-9dae-a97c44d4a1db</serial>
Apr 12 00:35:31 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:35:31 user nova-compute[82394]: </disk>
Apr 12 00:35:31 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:35:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config.
Apr 12 00:35:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:35:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:35:31 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:35:31 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:35:31 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:35:31 user nova-compute[82394]:   <serial>5b251160-965f-41ea-9dae-a97c44d4a1db</serial>
Apr 12 00:35:31 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:35:31 user nova-compute[82394]: </disk>
Apr 12 00:35:31 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259732.3533473, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:35:32 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config.
Apr 12 00:35:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJNDmZhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:32 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab65d40-b995-49f1-842c-9b61d1f99eb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:35:32 user nova-compute[82394]: No targets found.
Apr 12 00:35:32 user nova-compute[82394]: iSNS:
Apr 12 00:35:32 user nova-compute[82394]: No targets found.
Apr 12 00:35:32 user nova-compute[82394]: STATIC:
Apr 12 00:35:32 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:35:32 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:35:32 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:35:32 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db
Apr 12 00:35:32 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:35:32 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:35:32 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:35:32 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:35:32 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:35:32 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:35:32 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:35:32 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:35:32 user nova-compute[82394]: FIRMWARE:
Apr 12 00:35:32 user nova-compute[82394]: No targets found.
Apr 12 00:35:32 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:35:32 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:35:32 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f86bea-2401-4e90-8c82-435d6030c492]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3077391-94af-492f-810d-fb7eec6f1d19]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)
Apr 12 00:35:32 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:32 user nova-compute[82394]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db (non-flash)
Apr 12 00:35:32 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c30280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db'): ({'sde'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Removing single pathed devices sde {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5cea4-0b84-42d5-8f6b-98af9294151f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[08befc25-3820-4aae-bd80-45ffef62fb74]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flushing IO for device /dev/sde {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c7b90b-b603-4ce5-bce1-fa7c766d8dff]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acb1dbd-474d-4668-805d-397b40f83d95]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6c6d8-4993-4ef9-a194-8767223e07a8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[68938fb1-ad90-46c9-a70c-b55368c15926]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260]
Apr 12 00:35:32 user nova-compute[82394]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db, portal: 172.16.0.220,3260] successful.
Apr 12 00:35:32 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b251160-965f-41ea-9dae-a97c44d4a1db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b29f7-f364-4c94-8649-06987a177799]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== disconnect_volume: return (333ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:35:32 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:35:32 user nova-compute[82394]: INFO nova.compute.manager [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] instance snapshotting
Apr 12 00:35:32 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Beginning live snapshot process
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783.delta 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783.delta 1073741824" returned: 0 in 0.058s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 00:35:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.924s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:35:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:35:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 00:35:35 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:35:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783.delta /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783.delta /opt/stack/data/nova/instances/snapshots/tmpte7khrie/1061a0a6fd1542d8a97236a409e2c783" returned: 0 in 0.439s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Snapshot extracted, beginning image upload
Apr 12 00:35:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Snapshot image upload complete
Apr 12 00:35:37 user nova-compute[82394]: INFO nova.compute.manager [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Took 4.97 seconds to snapshot the instance on the hypervisor.
Apr 12 00:35:38 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:35:45 user nova-compute[82394]: INFO nova.compute.claims [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Claim successful on node user
Apr 12 00:35:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:35:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:45 user nova-compute[82394]: INFO nova.virt.block_device [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Booting with volume snapshot 5353d58f-cef2-4d6a-b87d-8f61ee082357 at /dev/vda
Apr 12 00:35:45 user nova-compute[82394]: DEBUG nova.policy [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:35:46 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Successfully created port: 903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:35:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Successfully updated port: 903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-changed-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Refreshing instance network info cache due to event network-changed-903dfac0-8003-4008-b135-5da44763c9ff. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Acquiring lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updating instance_info_cache with network_info: [{"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Instance network_info: |[{"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Acquired lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Refreshing network info cache for port 903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updated VIF entry in instance network info cache for port 903dfac0-8003-4008-b135-5da44763c9ff. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:35:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updating instance_info_cache with network_info: [{"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Releasing lock "refresh_cache-ba310127-67a9-4245-87f6-555e35f30a16" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:48 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:35:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.utils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8103ce-9f78-43dd-acef-f6d053761d62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f01ea-dad1-4650-90fe-9519fbb3663c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7f964-ec0f-49ad-bdfb-10e1f9f1861d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d1fc08-d966-4b79-affb-caa894ac6067]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:35:51 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[85634bf0-ae78-4eb0-9584-1492fa9582ab]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG os_brick.utils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updating existing volume attachment record: ec224325-fe10-4275-a36c-885caf2fd26e {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:53 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:53 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=26.329689025878906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d8833bad-d30f-4cd4-aa66-10d60c782061 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ba310127-67a9-4245-87f6-555e35f30a16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:35:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:35:54 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:35:54 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:35:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:35:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Skipping network cache update for instance because it is Building. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updating instance_info_cache with network_info: [{"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:35:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Creating image(s)
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Ensure instance console log exists: /opt/stack/data/nova/instances/ba310127-67a9-4245-87f6-555e35f30a16/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Start _get_guest_xml network_info=[{"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T00:35:42Z,direct_url=<?>,disk_format='qcow2',id=7a7cf27a-f1da-4da9-9e1f-94aab7e25de9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-216687367',owner='e38a98bf1d964ee6bd2d0d05e97a283a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T00:35:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ec224325-fe10-4275-a36c-885caf2fd26e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsaLgZAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba310127-67a9-4245-87f6-555e35f30a16', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ec9af9-0e26-4738-928f-8a4c475a856e', 'serial': 'c7ec9af9-0e26-4738-928f-8a4c475a856e'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:35:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T00:35:42Z,direct_url=<?>,disk_format='qcow2',id=7a7cf27a-f1da-4da9-9e1f-94aab7e25de9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-216687367',owner='e38a98bf1d964ee6bd2d0d05e97a283a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T00:35:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsaLgZAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:35:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:35:56 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d87751-7619-40ea-b2b9-18571edc61e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:35:56 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6bb543-7b9a-455a-a20b-421a8562eba1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e] added
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96f57c-77b5-46cb-b87f-9cfb1c6a00df]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7788159-68e9-4c3e-b028-53ee4ffc988c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsaLgZAz {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsaLgZAz" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[919cff5a-daf3-4975-b94b-1e2542207021]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsaLgZAz'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f8243-aafe-4f48-8726-7221ff96ede3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[66813cb4-1cf2-459f-a8ae-5d81be153434]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0050d8af-42fe-4aff-9c07-8665538ca04d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260]
Apr 12 00:35:56 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260] successful.
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f5932-f627-48ca-9c9f-def0f7c7fa83]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ddee40-a865-4067-becd-473d2fbeff10]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:35:56 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:35:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[38300256-42bb-4e3a-bbd1-63d00fe8eeed]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:35:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsaLgZAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26435386537343430', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435386537343430', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410164590',id=21,image_ref='7a7cf27a-f1da-4da9-9e1f-94aab7e25de9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-030gmfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-726466832',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:35:46Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ba310127-67a9-4245-87f6-555e35f30a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.objects.instance [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid ba310127-67a9-4245-87f6-555e35f30a16 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:35:57 user nova-compute[82394]:   <uuid>ba310127-67a9-4245-87f6-555e35f30a16</uuid>
Apr 12 00:35:57 user nova-compute[82394]:   <name>instance-00000015</name>
Apr 12 00:35:57 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:35:57 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:35:57 user nova-compute[82394]:   <metadata>
Apr 12 00:35:57 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:35:57 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-410164590</nova:name>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:35:56</nova:creationTime>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:35:57 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:35:57 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:owner>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:35:57 user nova-compute[82394]:       </nova:owner>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:root type="image" uuid="7a7cf27a-f1da-4da9-9e1f-94aab7e25de9"/>
Apr 12 00:35:57 user nova-compute[82394]:       <nova:ports>
Apr 12 00:35:57 user nova-compute[82394]:         <nova:port uuid="903dfac0-8003-4008-b135-5da44763c9ff">
Apr 12 00:35:57 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 00:35:57 user nova-compute[82394]:         </nova:port>
Apr 12 00:35:57 user nova-compute[82394]:       </nova:ports>
Apr 12 00:35:57 user nova-compute[82394]:     </nova:instance>
Apr 12 00:35:57 user nova-compute[82394]:   </metadata>
Apr 12 00:35:57 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:35:57 user nova-compute[82394]:     <system>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="serial">ba310127-67a9-4245-87f6-555e35f30a16</entry>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="uuid">ba310127-67a9-4245-87f6-555e35f30a16</entry>
Apr 12 00:35:57 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:35:57 user nova-compute[82394]:     </system>
Apr 12 00:35:57 user nova-compute[82394]:   </sysinfo>
Apr 12 00:35:57 user nova-compute[82394]:   <os>
Apr 12 00:35:57 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:35:57 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:35:57 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:35:57 user nova-compute[82394]:   </os>
Apr 12 00:35:57 user nova-compute[82394]:   <features>
Apr 12 00:35:57 user nova-compute[82394]:     <acpi/>
Apr 12 00:35:57 user nova-compute[82394]:     <apic/>
Apr 12 00:35:57 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:35:57 user nova-compute[82394]:   </features>
Apr 12 00:35:57 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:35:57 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:35:57 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:35:57 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:35:57 user nova-compute[82394]:   </clock>
Apr 12 00:35:57 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:35:57 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:35:57 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:35:57 user nova-compute[82394]:   </cpu>
Apr 12 00:35:57 user nova-compute[82394]:   <devices>
Apr 12 00:35:57 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:35:57 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:35:57 user nova-compute[82394]:       <source dev="/dev/sde"/>
Apr 12 00:35:57 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:35:57 user nova-compute[82394]:       <serial>c7ec9af9-0e26-4738-928f-8a4c475a856e</serial>
Apr 12 00:35:57 user nova-compute[82394]:     </disk>
Apr 12 00:35:57 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:35:57 user nova-compute[82394]:       <mac address="fa:16:3e:fe:f1:3b"/>
Apr 12 00:35:57 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:57 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:35:57 user nova-compute[82394]:       <target dev="tap903dfac0-80"/>
Apr 12 00:35:57 user nova-compute[82394]:     </interface>
Apr 12 00:35:57 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:35:57 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/ba310127-67a9-4245-87f6-555e35f30a16/console.log" append="off"/>
Apr 12 00:35:57 user nova-compute[82394]:     </serial>
Apr 12 00:35:57 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:35:57 user nova-compute[82394]:     <video>
Apr 12 00:35:57 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:35:57 user nova-compute[82394]:     </video>
Apr 12 00:35:57 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:35:57 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:35:57 user nova-compute[82394]:     </rng>
Apr 12 00:35:57 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:35:57 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:35:57 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:35:57 user nova-compute[82394]:     </memballoon>
Apr 12 00:35:57 user nova-compute[82394]:   </devices>
Apr 12 00:35:57 user nova-compute[82394]: </domain>
Apr 12 00:35:57 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410164590',id=21,image_ref='7a7cf27a-f1da-4da9-9e1f-94aab7e25de9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-030gmfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-726466832',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:35:46Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ba310127-67a9-4245-87f6-555e35f30a16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG os_vif [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903dfac0-80, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap903dfac0-80, col_values=(('external_ids', {'iface-id': '903dfac0-8003-4008-b135-5da44763c9ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:f1:3b', 'vm-uuid': 'ba310127-67a9-4245-87f6-555e35f30a16'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:57 user nova-compute[82394]: INFO os_vif [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80')
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:35:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:fe:f1:3b, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:35:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] No waiting events found dispatching network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:35:59 user nova-compute[82394]: WARNING nova.compute.manager [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received unexpected event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff for instance with vm_state building and task_state spawning.
Apr 12 00:35:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:35:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259761.1298661, ba310127-67a9-4245-87f6-555e35f30a16 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] VM Resumed (Lifecycle Event)
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Instance spawned successfully.
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-changed-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Refreshing instance network info cache due to event network-changed-a152413c-fa33-4f4e-8c91-2b8a8c5565b6. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Acquiring lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Acquired lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Refreshing network info cache for port a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259761.1340585, ba310127-67a9-4245-87f6-555e35f30a16 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] VM Started (Lifecycle Event)
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] No waiting events found dispatching network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:01 user nova-compute[82394]: WARNING nova.compute.manager [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received unexpected event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff for instance with vm_state building and task_state spawning.
Apr 12 00:36:01 user nova-compute[82394]: INFO nova.compute.manager [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Took 16.14 seconds to build instance.
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.241s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updated VIF entry in instance network info cache for port a152413c-fa33-4f4e-8c91-2b8a8c5565b6. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updating instance_info_cache with network_info: [{"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Releasing lock "refresh_cache-2bae2f38-fd5e-4d51-be63-22bbf54cd77a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-changed-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing instance network info cache due to event network-changed-f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Acquiring lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Acquired lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing network info cache for port f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:02 user nova-compute[82394]: INFO nova.compute.manager [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Attaching volume 04e2cfac-63fa-480c-a8bd-f583809971ab to /dev/vdb
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:03 user nova-compute[82394]: INFO nova.compute.manager [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Attaching volume 5b3f208d-e481-472f-8547-dd689d9f336a to /dev/vdb
Apr 12 00:36:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updated VIF entry in instance network info cache for port f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating instance_info_cache with network_info: [{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.utils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Releasing lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76645c9b-d7f3-4230-a3aa-5305a935f8a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.utils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a980331a-3cfd-41ee-83b7-be6d27ae60bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6530a4-2f07-427d-8ebe-cdc4cdb68cf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[63232ac6-0e54-4624-95b7-2f6a045fe2a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e84f41-13ef-4983-b1c8-7b52bb2b4ea0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c228d286-4d6b-42e5-98cc-481ba3cdda31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:03 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19a617-fc80-4ed9-87df-ebcab556378a]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.utils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updating existing volume attachment record: 18d41df8-6737-4caa-be5d-4b6e0d18f990 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[50584f6e-5277-456b-847c-517c2f1d9a72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4697ca2a-ee1c-4475-be08-69d23a076265]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:03 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:36:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e84e56-ee4a-46d6-b9fa-51ff5933e815]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG os_brick.utils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:03 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating existing volume attachment record: cd503198-9bcb-48ea-a0d4-58150b5ce099 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:36:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFawTbdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:10 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9405fd-0abf-4f18-befc-3f40d5f74968]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:36:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283ec47-a5fc-407e-a78e-644538aec4c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab] added
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[024b3852-a420-4453-97db-36f571f38833]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0271a667-53d9-45de-a001-4c1e932d65f0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFawTbdC {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFawTbdC" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35ed97-a545-4adc-8fc8-605200364458]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFawTbdC'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09617a3-9fa1-4ffe-b94e-937de8538390]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ed1aa-fa05-456c-995b-e0c0d4bd03b5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688ce03-b485-474d-90a2-91ec8f440585]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260]
Apr 12 00:36:10 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e3e72-6c9f-40b6-b253-8f47b88094dc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bff2077-216d-4aee-b1f3-d053eb62d454]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:10 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f32e1f-3e59-4acb-b59b-6e51ef7cf664]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFawTbdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phUcDyxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:11 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23532626131643337', 'path': '/dev/sdf'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532626131643337', 'path': '/dev/sdf'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.045s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:11 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:11 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG nova.objects.instance [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11ea2c-9a1e-47c3-8602-77099227bf72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:36:11 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:36:11 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:11 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:36:11 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:11 user nova-compute[82394]:   <serial>04e2cfac-63fa-480c-a8bd-f583809971ab</serial>
Apr 12 00:36:11 user nova-compute[82394]: </disk>
Apr 12 00:36:11 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e27a482-883b-4651-9f88-41e33470a6b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a] added
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[49028537-b2de-4fc0-bda7-e98ba416db79]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f89a7-d684-4c10-b624-4ff09369a01a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phUcDyxN {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phUcDyxN" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce3f705-b126-4f79-9d06-39a0bd147984]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'phUcDyxN'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9772288c-e4c0-47c5-a63c-c0a28c25f382]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d70ef-28ef-4148-bdf2-1e7665b89c3d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1053a-18c8-4532-a656-3c67db326ce5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260]
Apr 12 00:36:11 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7781823-f957-4fed-942b-a9e6171f731e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a161d9-ab41-464a-b36d-88912d828915]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:11 user nova-compute[82394]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)
Apr 12 00:36:11 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[36897f37-e598-4545-a522-602d13ab2de3]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phUcDyxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:4e:19:52, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.301s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26665333639383934', 'path': '/dev/sdg'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665333639383934', 'path': '/dev/sdg'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:36:12 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:36:13 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:13 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:13 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:13 user nova-compute[82394]:   <serial>5b3f208d-e481-472f-8547-dd689d9f336a</serial>
Apr 12 00:36:13 user nova-compute[82394]: </disk>
Apr 12 00:36:13 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] No VIF found with MAC fa:16:3e:6a:a6:53, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:13 user nova-compute[82394]: INFO nova.compute.manager [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Terminating instance
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.623s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-unplugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] No waiting events found dispatching network-vif-unplugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-unplugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Instance destroyed successfully.
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lazy-loading 'resources' on Instance uuid 1b203e2e-a2ba-4989-94bc-2a78491a9b89 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1849840891',display_name='tempest-VolumesActionsTest-instance-1849840891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1849840891',id=19,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48be6d35ad6c43c8b048811baffb8da8',ramdisk_id='',reservation_id='r-rkmgedqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-69590984',owner_user_name='tempest-VolumesActionsTest-69590984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:34:26Z,user_data=None,user_id='f6d875a6e14446469a8a58b97a0e89d4',uuid=1b203e2e-a2ba-4989-94bc-2a78491a9b89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converting VIF {"id": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "address": "fa:16:3e:c7:d6:9a", "network": {"id": "904a9a3f-6997-40cc-bf7d-26952bba0f10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2080547957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "48be6d35ad6c43c8b048811baffb8da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857280d0-ef", "ovs_interfaceid": "857280d0-efc9-4f7f-988a-ca07d7d5f957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG os_vif [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap857280d0-ef, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:36:14 user nova-compute[82394]: INFO os_vif [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d6:9a,bridge_name='br-int',has_traffic_filtering=True,id=857280d0-efc9-4f7f-988a-ca07d7d5f957,network=Network(904a9a3f-6997-40cc-bf7d-26952bba0f10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857280d0-ef')
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Deleting instance files /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89_del
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Deletion of /opt/stack/data/nova/instances/1b203e2e-a2ba-4989-94bc-2a78491a9b89_del complete
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.compute.manager [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 12 00:36:14 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.compute.manager [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Detaching volume 5b3f208d-e481-472f-8547-dd689d9f336a
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.virt.block_device [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Attempting to driver detach volume 5b3f208d-e481-472f-8547-dd689d9f336a from mountpoint /dev/vdb
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Attempting to detach device vdb from instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:14 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:14 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:14 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:14 user nova-compute[82394]:   <serial>5b3f208d-e481-472f-8547-dd689d9f336a</serial>
Apr 12 00:36:14 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:36:14 user nova-compute[82394]: </disk>
Apr 12 00:36:14 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:14 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully detached device vdb from instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 from the persistent domain config.
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:14 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:14 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:14 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:14 user nova-compute[82394]:   <serial>5b3f208d-e481-472f-8547-dd689d9f336a</serial>
Apr 12 00:36:14 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:36:14 user nova-compute[82394]: </disk>
Apr 12 00:36:14 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:14 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-deleted-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:15 user nova-compute[82394]: INFO nova.compute.manager [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Neutron deleted interface 857280d0-efc9-4f7f-988a-ca07d7d5f957; detaching it from the instance and deleting it from the info cache
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.network.neutron [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:15 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Took 0.77 seconds to deallocate network for instance.
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Detach interface failed, port_id=857280d0-efc9-4f7f-988a-ca07d7d5f957, reason: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259775.1400783, 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:36:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully detached device vdb from instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 from the live domain config.
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phUcDyxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:15 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c407e95b-48ea-4a0d-aa01-c038bc913d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:36:15 user nova-compute[82394]: No targets found.
Apr 12 00:36:15 user nova-compute[82394]: iSNS:
Apr 12 00:36:15 user nova-compute[82394]: No targets found.
Apr 12 00:36:15 user nova-compute[82394]: STATIC:
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:36:15 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:15 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:15 user nova-compute[82394]: FIRMWARE:
Apr 12 00:36:15 user nova-compute[82394]: No targets found.
Apr 12 00:36:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:36:15 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:36:15 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f40cb-332e-463a-9698-afa4c2dbd1ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1574a6a-2fa1-4df2-ad18-bf271889faa0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)
Apr 12 00:36:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:15 user nova-compute[82394]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a (non-flash)
Apr 12 00:36:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343ce7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a'): ({'sdg'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Removing single pathed devices sdg {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd204de-92a0-4a6a-8e0f-369649f8e361]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2570a7-c983-4c8a-87a3-e44b5b936c2c]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flushing IO for device /dev/sdg {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d34f0-e67f-489d-bd7a-9f83748420dd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f8d43c-fa2b-4998-a1ad-a98459c6001d]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb8f80-610c-4cfb-8d35-0bbda1e02b35]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3302ffef-f378-4b97-b0d5-e8a53dfe029f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260]
Apr 12 00:36:15 user nova-compute[82394]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3f208d-e481-472f-8547-dd689d9f336a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a3f0e7-5e13-4a23-9939-59b7da8e0ebe]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] <== disconnect_volume: return (347ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:15 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Deleted allocations for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Acquiring lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Lock "1b203e2e-a2ba-4989-94bc-2a78491a9b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] No waiting events found dispatching network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:15 user nova-compute[82394]: WARNING nova.compute.manager [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Received unexpected event network-vif-plugged-857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance with vm_state deleted and task_state None.
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:36:16 user nova-compute[82394]: INFO nova.compute.claims [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Claim successful on node user
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'flavor' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:36:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.policy [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:36:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Creating image(s)
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk 1073741824" returned: 0 in 0.046s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Successfully created port: 4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Cannot resize image /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'migration_context' on Instance uuid 8fd7bb9c-9e20-49f2-8848-162a784b9885 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Ensure instance console log exists: /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Successfully updated port: 4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquired lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-changed-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Refreshing instance network info cache due to event network-changed-4e105e43-5ee4-46ca-a01a-be1a58096a0a. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Acquiring lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updating instance_info_cache with network_info: [{"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Releasing lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Instance network_info: |[{"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Acquired lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Refreshing network info cache for port 4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Start _get_guest_xml network_info=[{"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:36:18 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:18 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267379931',display_name='tempest-AttachVolumeNegativeTest-server-267379931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267379931',id=22,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHLuxBkm6l01yjTwTdI1oiZ9aYwN/CnkMAfV6gxx8VJgA1NcUdSBeVuPz9wX3aWjmvtFSrqyDF/6dJS/nZiFNgFQ/beyg+GrmUzZrVy2Dcklya2DeprEvo0CkCYCFDqXA==',key_name='tempest-keypair-665321536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-4oium4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=8fd7bb9c-9e20-49f2-8848-162a784b9885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.objects.instance [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fd7bb9c-9e20-49f2-8848-162a784b9885 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:36:18 user nova-compute[82394]:   <uuid>8fd7bb9c-9e20-49f2-8848-162a784b9885</uuid>
Apr 12 00:36:18 user nova-compute[82394]:   <name>instance-00000016</name>
Apr 12 00:36:18 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:36:18 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:36:18 user nova-compute[82394]:   <metadata>
Apr 12 00:36:18 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:36:18 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeNegativeTest-server-267379931</nova:name>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:36:18</nova:creationTime>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:36:18 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:36:18 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:owner>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:user uuid="d373f582479c441e8ce9849ca694a186">tempest-AttachVolumeNegativeTest-2076679017-project-member</nova:user>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:project uuid="b56f3c567dc84773a33d596920df727a">tempest-AttachVolumeNegativeTest-2076679017</nova:project>
Apr 12 00:36:18 user nova-compute[82394]:       </nova:owner>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:36:18 user nova-compute[82394]:       <nova:ports>
Apr 12 00:36:18 user nova-compute[82394]:         <nova:port uuid="4e105e43-5ee4-46ca-a01a-be1a58096a0a">
Apr 12 00:36:18 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 00:36:18 user nova-compute[82394]:         </nova:port>
Apr 12 00:36:18 user nova-compute[82394]:       </nova:ports>
Apr 12 00:36:18 user nova-compute[82394]:     </nova:instance>
Apr 12 00:36:18 user nova-compute[82394]:   </metadata>
Apr 12 00:36:18 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:36:18 user nova-compute[82394]:     <system>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="serial">8fd7bb9c-9e20-49f2-8848-162a784b9885</entry>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="uuid">8fd7bb9c-9e20-49f2-8848-162a784b9885</entry>
Apr 12 00:36:18 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:36:18 user nova-compute[82394]:     </system>
Apr 12 00:36:18 user nova-compute[82394]:   </sysinfo>
Apr 12 00:36:18 user nova-compute[82394]:   <os>
Apr 12 00:36:18 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:36:18 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:36:18 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:36:18 user nova-compute[82394]:   </os>
Apr 12 00:36:18 user nova-compute[82394]:   <features>
Apr 12 00:36:18 user nova-compute[82394]:     <acpi/>
Apr 12 00:36:18 user nova-compute[82394]:     <apic/>
Apr 12 00:36:18 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:36:18 user nova-compute[82394]:   </features>
Apr 12 00:36:18 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:36:18 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:36:18 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:36:18 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:36:18 user nova-compute[82394]:   </clock>
Apr 12 00:36:18 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:36:18 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:36:18 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:36:18 user nova-compute[82394]:   </cpu>
Apr 12 00:36:18 user nova-compute[82394]:   <devices>
Apr 12 00:36:18 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:36:18 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:36:18 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk"/>
Apr 12 00:36:18 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:36:18 user nova-compute[82394]:     </disk>
Apr 12 00:36:18 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:36:18 user nova-compute[82394]:       <mac address="fa:16:3e:05:d1:b3"/>
Apr 12 00:36:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:36:18 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:36:18 user nova-compute[82394]:       <target dev="tap4e105e43-5e"/>
Apr 12 00:36:18 user nova-compute[82394]:     </interface>
Apr 12 00:36:18 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:36:18 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/console.log" append="off"/>
Apr 12 00:36:18 user nova-compute[82394]:     </serial>
Apr 12 00:36:18 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:36:18 user nova-compute[82394]:     <video>
Apr 12 00:36:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:36:18 user nova-compute[82394]:     </video>
Apr 12 00:36:18 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:36:18 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:36:18 user nova-compute[82394]:     </rng>
Apr 12 00:36:18 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:36:18 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:36:18 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:36:18 user nova-compute[82394]:     </memballoon>
Apr 12 00:36:18 user nova-compute[82394]:   </devices>
Apr 12 00:36:18 user nova-compute[82394]: </domain>
Apr 12 00:36:18 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267379931',display_name='tempest-AttachVolumeNegativeTest-server-267379931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267379931',id=22,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHLuxBkm6l01yjTwTdI1oiZ9aYwN/CnkMAfV6gxx8VJgA1NcUdSBeVuPz9wX3aWjmvtFSrqyDF/6dJS/nZiFNgFQ/beyg+GrmUzZrVy2Dcklya2DeprEvo0CkCYCFDqXA==',key_name='tempest-keypair-665321536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-4oium4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=8fd7bb9c-9e20-49f2-8848-162a784b9885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG os_vif [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e105e43-5e, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e105e43-5e, col_values=(('external_ids', {'iface-id': '4e105e43-5ee4-46ca-a01a-be1a58096a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:d1:b3', 'vm-uuid': '8fd7bb9c-9e20-49f2-8848-162a784b9885'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:18 user nova-compute[82394]: INFO os_vif [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e')
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:05:d1:b3, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updated VIF entry in instance network info cache for port 4e105e43-5ee4-46ca-a01a-be1a58096a0a. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updating instance_info_cache with network_info: [{"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Releasing lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] No waiting events found dispatching network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:20 user nova-compute[82394]: WARNING nova.compute.manager [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received unexpected event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance with vm_state building and task_state spawning.
Apr 12 00:36:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259782.1159737, 8fd7bb9c-9e20-49f2-8848-162a784b9885 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] VM Resumed (Lifecycle Event)
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Instance spawned successfully.
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259782.1200812, 8fd7bb9c-9e20-49f2-8848-162a784b9885 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] VM Started (Lifecycle Event)
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] No waiting events found dispatching network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:22 user nova-compute[82394]: WARNING nova.compute.manager [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received unexpected event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance with vm_state building and task_state spawning.
Apr 12 00:36:22 user nova-compute[82394]: INFO nova.compute.manager [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Took 6.29 seconds to build instance.
Apr 12 00:36:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.380s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:24 user nova-compute[82394]: INFO nova.compute.manager [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Unrescuing
Apr 12 00:36:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:25 user nova-compute[82394]: INFO nova.compute.manager [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attaching volume 2a37b7b1-c215-42f1-96c3-1bd1248aacc1 to /dev/vdb
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae081f-4d7d-4b58-9abf-84ebc93f979a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae035edd-09a2-455b-bedc-19e5bacc40d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6994ee2-2f68-4e4a-8eb6-5a82a998583e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde5c9c-9ad5-4115-9f21-3113efa8f9e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:25 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4abf2-7914-489b-aa40-8163688abf6d]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating existing volume attachment record: abaedb00-bf6f-4b9d-8165-219bce934209 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:25 user nova-compute[82394]: WARNING nova.compute.manager [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:36:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance destroyed successfully.
Apr 12 00:36:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:27 user nova-compute[82394]: WARNING nova.compute.manager [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:36:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259774.1468768, 1b203e2e-a2ba-4989-94bc-2a78491a9b89 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:29 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] VM Stopped (Lifecycle Event)
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7c3bc017-b6a3-4fae-b860-6e7c78ce744f None None] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHbnpSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:29 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06354dc-0b30-4323-95ed-a6a958889cdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:36:29 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:29 user nova-compute[82394]: WARNING nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:29 user nova-compute[82394]: WARNING nova.compute.manager [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[20886765-b3f5-4ea4-8a79-2475be57a8fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1] added
Apr 12 00:36:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c2052-8f90-45d7-91df-9eed1577c9b3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a74e13-b6b3-4296-83cd-4063cd27ab7f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHbnpSL {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHbnpSL" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c3470-4508-4815-a7e3-1d48ebcacd97]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gxHbnpSL'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 8d895d64-319f-4c67-8c20-ef0d0437a1f0 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259789.872782, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:29 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Resumed (Lifecycle Event)
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be55e4b-534b-4879-a08d-4038be923da7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9647ca2-be77-4089-916d-ed7f77d6c5a1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:29 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:29 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259789.873811, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:29 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Started (Lifecycle Event)
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12faa9a-b54e-4973-b69d-f39bf98c2b2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260]
Apr 12 00:36:30 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6653f2-cc5d-423b-8ebb-bc5f85a951a2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd162b63-c332-4698-a756-1ac17c8555f1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)
Apr 12 00:36:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:30 user nova-compute[82394]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)
Apr 12 00:36:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[89132a5c-1b20-4bfd-b0df-50906a99b349]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHbnpSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23362636238653735', 'path': '/dev/sdg'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362636238653735', 'path': '/dev/sdg'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:36:31 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:31 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:31 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:31 user nova-compute[82394]:   <serial>2a37b7b1-c215-42f1-96c3-1bd1248aacc1</serial>
Apr 12 00:36:31 user nova-compute[82394]: </disk>
Apr 12 00:36:31 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid d8833bad-d30f-4cd4-aa66-10d60c782061 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid ba310127-67a9-4245-87f6-555e35f30a16 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 8fd7bb9c-9e20-49f2-8848-162a784b9885 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "ba310127-67a9-4245-87f6-555e35f30a16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: WARNING oslo_messaging._drivers.amqpdriver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "ba310127-67a9-4245-87f6-555e35f30a16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.187s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] No VIF found with MAC fa:16:3e:ad:aa:95, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.619s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.537s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:33 user nova-compute[82394]: INFO nova.compute.manager [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Detaching volume 2a37b7b1-c215-42f1-96c3-1bd1248aacc1
Apr 12 00:36:33 user nova-compute[82394]: INFO nova.virt.block_device [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Attempting to driver detach volume 2a37b7b1-c215-42f1-96c3-1bd1248aacc1 from mountpoint /dev/vdb
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Attempting to detach device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:33 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:33 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:33 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:33 user nova-compute[82394]:   <serial>2a37b7b1-c215-42f1-96c3-1bd1248aacc1</serial>
Apr 12 00:36:33 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:36:33 user nova-compute[82394]: </disk>
Apr 12 00:36:33 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the persistent domain config.
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:33 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:33 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:36:33 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:33 user nova-compute[82394]:   <serial>2a37b7b1-c215-42f1-96c3-1bd1248aacc1</serial>
Apr 12 00:36:33 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:36:33 user nova-compute[82394]: </disk>
Apr 12 00:36:33 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259793.9809673, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:36:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully detached device vdb from instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 from the live domain config.
Apr 12 00:36:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHbnpSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:33 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5457e6-32eb-4c2a-89f5-ed0500c7d3eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:36:34 user nova-compute[82394]: No targets found.
Apr 12 00:36:34 user nova-compute[82394]: iSNS:
Apr 12 00:36:34 user nova-compute[82394]: No targets found.
Apr 12 00:36:34 user nova-compute[82394]: STATIC:
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:36:34 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:34 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:34 user nova-compute[82394]: FIRMWARE:
Apr 12 00:36:34 user nova-compute[82394]: No targets found.
Apr 12 00:36:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:36:34 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:36:34 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e281f3d8-e7de-40f6-9036-afb62ed9895b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c00a8c-54eb-48a1-86ef-68a7a22dbb40]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)
Apr 12 00:36:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:34 user nova-compute[82394]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 (non-flash)
Apr 12 00:36:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2341384c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1'): ({'sdg'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Removing single pathed devices sdg {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ec83a9-02d8-462e-ac2b-d641eabe4b7e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa40ece0-54f2-43ea-a1c0-34fb45f2c85b]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flushing IO for device /dev/sdg {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1446668-1993-47da-bdab-d1940d085291]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545b3a2-6811-4fa7-ad42-b09d3c489ac2]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6dded-2692-4504-8c7a-31536837d7b5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[07594945-bea3-4807-9f0e-764206d166ec]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260]
Apr 12 00:36:34 user nova-compute[82394]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:34 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a37b7b1-c215-42f1-96c3-1bd1248aacc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[916856d1-5b62-4858-a51d-e2e34e2df0eb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] <== disconnect_volume: return (349ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:36:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'flavor' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:36:39 user nova-compute[82394]: INFO nova.compute.claims [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Claim successful on node user
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:36:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:36:39 user nova-compute[82394]: INFO nova.virt.block_device [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Booting with blank volume at /dev/vda
Apr 12 00:36:39 user nova-compute[82394]: DEBUG nova.policy [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:36:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:40 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Successfully created port: 8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:36:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Successfully updated port: 8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-changed-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Refreshing instance network info cache due to event network-changed-8e32719d-1d2e-439a-9dba-9ac82140fbac. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance network_info: |[{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:41 user nova-compute[82394]: DEBUG nova.network.neutron [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Refreshing network info cache for port 8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:36:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updated VIF entry in instance network info cache for port 8e32719d-1d2e-439a-9dba-9ac82140fbac. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:36:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:44 user nova-compute[82394]: INFO nova.compute.manager [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Detaching volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:36:44 user nova-compute[82394]: INFO nova.virt.block_device [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attempting to driver detach volume d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 from mountpoint /dev/vdb
Apr 12 00:36:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Attempting to detach device vdb from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:36:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:44 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:44 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 00:36:44 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:44 user nova-compute[82394]:   <serial>d0edc110-1f0c-4311-b54d-6de6a1d1d8f2</serial>
Apr 12 00:36:44 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:36:44 user nova-compute[82394]: </disk>
Apr 12 00:36:44 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully detached device vdb from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the persistent domain config.
Apr 12 00:36:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:36:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:36:44 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:44 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 00:36:44 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:36:44 user nova-compute[82394]:   <serial>d0edc110-1f0c-4311-b54d-6de6a1d1d8f2</serial>
Apr 12 00:36:44 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:36:44 user nova-compute[82394]: </disk>
Apr 12 00:36:44 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259805.3741186, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:36:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully detached device vdb from instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 from the live domain config.
Apr 12 00:36:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmniFKtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:45 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[81339780-ea0a-4a67-b9e6-a200013bc024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:36:45 user nova-compute[82394]: No targets found.
Apr 12 00:36:45 user nova-compute[82394]: iSNS:
Apr 12 00:36:45 user nova-compute[82394]: No targets found.
Apr 12 00:36:45 user nova-compute[82394]: STATIC:
Apr 12 00:36:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2
Apr 12 00:36:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:36:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:36:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:36:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:36:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:36:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:36:45 user nova-compute[82394]: FIRMWARE:
Apr 12 00:36:45 user nova-compute[82394]: No targets found.
Apr 12 00:36:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:36:45 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:36:45 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8acba-a4d4-4f2a-b143-4fc380c5918f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a51a10-2237-4b9b-bc36-4de72e4d4250]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:45 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2344628c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2'): ({'sdc'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdc {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ebe03-bf54-482c-ba51-863a0b9df26f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.utils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ffde6a-ac42-414f-b8f3-de2ef6e61195]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdc {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfdcc11-4a13-4bda-9fbc-9ba1d6598c4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0f61d2-13a7-4045-ac8c-6ecd3ff4f6c7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e507e91-c03f-40a8-bbe9-af0d20f390e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb78042-d0c0-4887-805a-a3d867cb1b34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f1443-b796-4623-9a52-10a841598408]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f37cf-997d-42be-a137-32a214aa72f2]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:45 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0777cdd-b1ea-4b17-ac10-e4fcca1b3f97]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.utils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating existing volume attachment record: 9b673f43-481a-43c4-8563-ac28641ccda3 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf551ca-de34-4f8e-ad4f-28c8855cb1c2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a5c327-7ced-4dd9-8b13-d1985cf3afa5]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260]
Apr 12 00:36:45 user nova-compute[82394]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11cabd-db3e-481c-991b-a11aa33cd1ae]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (393ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:36:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'flavor' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.023s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:36:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:49 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:36:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Creating image(s)
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Ensure instance console log exists: /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start _get_guest_xml network_info=[{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b673f43-481a-43c4-8563-ac28641ccda3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1277a40a-6389-4d88-bbc6-bda27d465c35', 'attached_at': '', 'detached_at': '', 'volume_id': '01b6e07b-a45a-42a0-92d7-19f59724fca7', 'serial': '01b6e07b-a45a-42a0-92d7-19f59724fca7'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:36:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:50 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d13770b-33ca-4008-b1b4-191d0eb3f0ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:36:50 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a9b7c5-d0be-4b29-a5e7-a1886deee9cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7] added
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7051a72-61cd-40a2-97a7-1083be717710]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e259e95-f6a1-4ef7-8a7b-833baaa8ea8c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhQHbDd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhQHbDd" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40c512-0dd5-46d8-bcd0-a9a66dce787d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmhQHbDd'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fc679-2a19-4cf3-9eef-92f3261eab01]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565c06e-a031-4499-8968-89ac8de8ad94]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48f8821-cad6-4f31-975a-d79478aef181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260]
Apr 12 00:36:50 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd62dfb-3bfb-4c47-8a5a-c010cd495ff5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e6b9db-1f85-428e-abb1-b8e44b552dcb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:50 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc901e6c-b5e6-4d45-99e9-a242d947f751]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23438353433333065', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438353433333065', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-241003630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-241003630',id=23,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-usfiymz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:36:40Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=1277a40a-6389-4d88-bbc6-bda27d465c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:36:51 user nova-compute[82394]:   <uuid>1277a40a-6389-4d88-bbc6-bda27d465c35</uuid>
Apr 12 00:36:51 user nova-compute[82394]:   <name>instance-00000017</name>
Apr 12 00:36:51 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:36:51 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:36:51 user nova-compute[82394]:   <metadata>
Apr 12 00:36:51 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:36:51 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-241003630</nova:name>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:36:50</nova:creationTime>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:36:51 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:36:51 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:owner>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:36:51 user nova-compute[82394]:       </nova:owner>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:36:51 user nova-compute[82394]:       <nova:ports>
Apr 12 00:36:51 user nova-compute[82394]:         <nova:port uuid="8e32719d-1d2e-439a-9dba-9ac82140fbac">
Apr 12 00:36:51 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:36:51 user nova-compute[82394]:         </nova:port>
Apr 12 00:36:51 user nova-compute[82394]:       </nova:ports>
Apr 12 00:36:51 user nova-compute[82394]:     </nova:instance>
Apr 12 00:36:51 user nova-compute[82394]:   </metadata>
Apr 12 00:36:51 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:36:51 user nova-compute[82394]:     <system>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="serial">1277a40a-6389-4d88-bbc6-bda27d465c35</entry>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="uuid">1277a40a-6389-4d88-bbc6-bda27d465c35</entry>
Apr 12 00:36:51 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:36:51 user nova-compute[82394]:     </system>
Apr 12 00:36:51 user nova-compute[82394]:   </sysinfo>
Apr 12 00:36:51 user nova-compute[82394]:   <os>
Apr 12 00:36:51 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:36:51 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:36:51 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:36:51 user nova-compute[82394]:   </os>
Apr 12 00:36:51 user nova-compute[82394]:   <features>
Apr 12 00:36:51 user nova-compute[82394]:     <acpi/>
Apr 12 00:36:51 user nova-compute[82394]:     <apic/>
Apr 12 00:36:51 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:36:51 user nova-compute[82394]:   </features>
Apr 12 00:36:51 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:36:51 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:36:51 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:36:51 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:36:51 user nova-compute[82394]:   </clock>
Apr 12 00:36:51 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:36:51 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:36:51 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:36:51 user nova-compute[82394]:   </cpu>
Apr 12 00:36:51 user nova-compute[82394]:   <devices>
Apr 12 00:36:51 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:36:51 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:36:51 user nova-compute[82394]:       <source dev="/dev/sdc"/>
Apr 12 00:36:51 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:36:51 user nova-compute[82394]:       <serial>01b6e07b-a45a-42a0-92d7-19f59724fca7</serial>
Apr 12 00:36:51 user nova-compute[82394]:     </disk>
Apr 12 00:36:51 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:36:51 user nova-compute[82394]:       <mac address="fa:16:3e:84:89:8e"/>
Apr 12 00:36:51 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:36:51 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:36:51 user nova-compute[82394]:       <target dev="tap8e32719d-1d"/>
Apr 12 00:36:51 user nova-compute[82394]:     </interface>
Apr 12 00:36:51 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:36:51 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/console.log" append="off"/>
Apr 12 00:36:51 user nova-compute[82394]:     </serial>
Apr 12 00:36:51 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:36:51 user nova-compute[82394]:     <video>
Apr 12 00:36:51 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:36:51 user nova-compute[82394]:     </video>
Apr 12 00:36:51 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:36:51 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:36:51 user nova-compute[82394]:     </rng>
Apr 12 00:36:51 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:36:51 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:36:51 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:36:51 user nova-compute[82394]:     </memballoon>
Apr 12 00:36:51 user nova-compute[82394]:   </devices>
Apr 12 00:36:51 user nova-compute[82394]: </domain>
Apr 12 00:36:51 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-241003630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-241003630',id=23,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-usfiymz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:36:40Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=1277a40a-6389-4d88-bbc6-bda27d465c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG os_vif [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e32719d-1d, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e32719d-1d, col_values=(('external_ids', {'iface-id': '8e32719d-1d2e-439a-9dba-9ac82140fbac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:89:8e', 'vm-uuid': '1277a40a-6389-4d88-bbc6-bda27d465c35'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:51 user nova-compute[82394]: INFO os_vif [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d')
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:84:89:8e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-changed-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Refreshing instance network info cache due to event network-changed-40e300fb-a2c9-4770-8eee-d1b48baedf34. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Acquiring lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Acquired lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG nova.network.neutron [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Refreshing network info cache for port 40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:53 user nova-compute[82394]: WARNING nova.compute.manager [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state building and task_state spawning.
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG nova.network.neutron [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updated VIF entry in instance network info cache for port 40e300fb-a2c9-4770-8eee-d1b48baedf34. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG nova.network.neutron [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updating instance_info_cache with network_info: [{"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Releasing lock "refresh_cache-88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:54 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:54 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7053MB free_disk=26.333934783935547GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d8833bad-d30f-4cd4-aa66-10d60c782061 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ba310127-67a9-4245-87f6-555e35f30a16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=2432MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'flavor' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:54 user nova-compute[82394]: INFO nova.compute.manager [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Attaching volume 0c45fcda-6866-44db-b3a0-bd507315f343 to /dev/vdb
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.utils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40108ee-dfcb-4b2a-9cf7-c852de9797d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b83e24-0c34-49ac-9887-ea751b0c3cb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce2530-7f09-4edf-893b-0f9233865b58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94cafc5-421f-4edf-8ac6-c40cf036b047]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:36:54 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:36:54 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[38851750-f2fe-435f-9702-37bd3047c193]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG os_brick.utils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updating existing volume attachment record: 2f46906c-2d4a-4a99-9949-e85a00c6c9e7 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:36:54 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:36:55 user nova-compute[82394]: WARNING nova.compute.manager [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state building and task_state spawning.
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259815.4446943, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Resumed (Lifecycle Event)
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance spawned successfully.
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259815.4462545, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Started (Lifecycle Event)
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 12 00:36:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:36:55 user nova-compute[82394]: INFO nova.compute.manager [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Took 16.40 seconds to build instance.
Apr 12 00:36:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.504s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:36:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgZUBqjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:36:59 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:59 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:36:59 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de375c3-4cd7-4d7a-8451-a12c427964b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:36:59 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5f7da-179e-437a-8116-6f518931e99f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343] added
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d399a-5b0f-4538-a52e-5771662d1207]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5740f-1b37-4541-8d78-32ddffe12605]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgZUBqjK {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgZUBqjK" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce19b2d-c874-4937-b4e8-348ee80720ec]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgZUBqjK'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec5091b-e88b-453e-ad42-1602cb4192be]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5851a-5e57-4738-9142-2f2f3093ee0b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf0c90-77ba-440c-ada9-5d801ed79581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260]
Apr 12 00:36:59 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260] successful.
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd9a963-058a-472e-a3cc-c1cbf780f1b2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bb44b7-6f03-4f4f-b60a-f2b332a93ee0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)
Apr 12 00:36:59 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f775d2a-f21b-4fc9-a511-12bcde18955b]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:36:59 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgZUBqjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26336306436393033', 'path': '/dev/sdg'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336306436393033', 'path': '/dev/sdg'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'flavor' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:37:00 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:37:00 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:37:00 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:37:00 user nova-compute[82394]:   <serial>0c45fcda-6866-44db-b3a0-bd507315f343</serial>
Apr 12 00:37:00 user nova-compute[82394]: </disk>
Apr 12 00:37:00 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:37:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No VIF found with MAC fa:16:3e:e8:3b:ed, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:37:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.383s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:01 user nova-compute[82394]: INFO nova.compute.manager [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Detaching volume 0c45fcda-6866-44db-b3a0-bd507315f343
Apr 12 00:37:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:01 user nova-compute[82394]: INFO nova.virt.block_device [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Attempting to driver detach volume 0c45fcda-6866-44db-b3a0-bd507315f343 from mountpoint /dev/vdb
Apr 12 00:37:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Attempting to detach device vdb from instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:37:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:37:01 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:37:01 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:37:01 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:37:01 user nova-compute[82394]:   <serial>0c45fcda-6866-44db-b3a0-bd507315f343</serial>
Apr 12 00:37:01 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:37:01 user nova-compute[82394]: </disk>
Apr 12 00:37:01 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:37:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully detached device vdb from instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 from the persistent domain config.
Apr 12 00:37:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:37:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:37:01 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:37:01 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:37:01 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:37:01 user nova-compute[82394]:   <serial>0c45fcda-6866-44db-b3a0-bd507315f343</serial>
Apr 12 00:37:01 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:37:01 user nova-compute[82394]: </disk>
Apr 12 00:37:01 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259822.0726054, 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:37:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully detached device vdb from instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 from the live domain config.
Apr 12 00:37:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgZUBqjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:37:02 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02453138-542c-445e-adb2-b8ef3a977d41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:37:02 user nova-compute[82394]: No targets found.
Apr 12 00:37:02 user nova-compute[82394]: iSNS:
Apr 12 00:37:02 user nova-compute[82394]: No targets found.
Apr 12 00:37:02 user nova-compute[82394]: STATIC:
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:37:02 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:02 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:02 user nova-compute[82394]: FIRMWARE:
Apr 12 00:37:02 user nova-compute[82394]: No targets found.
Apr 12 00:37:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:37:02 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:37:02 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d85d6c4-3703-45c5-88e0-890a458aec47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2314288-887c-4965-b9c4-4d062faa5f59]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)
Apr 12 00:37:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:02 user nova-compute[82394]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 (non-flash)
Apr 12 00:37:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343ccaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343'): ({'sdg'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Removing single pathed devices sdg {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e02b0c-7a34-426b-820e-5d6e21a0f083]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a75f14-a67d-429d-8a22-9500c6e3b397]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flushing IO for device /dev/sdg {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceb7a16-2d41-43c8-aff3-bedefb7ca68a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f8b72e-7d0e-420c-a3bf-a167d66b2451]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d885ac-04d2-41de-abbd-7c9973252085]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8bf71-6dbe-473c-9c1e-14861204c5e2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260]
Apr 12 00:37:02 user nova-compute[82394]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343, portal: 172.16.0.220,3260] successful.
Apr 12 00:37:02 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c45fcda-6866-44db-b3a0-bd507315f343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35ced4-ad16-4a65-b7c8-a49abb2018b3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] <== disconnect_volume: return (306ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:37:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.objects.instance [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'flavor' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.630s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.compute.manager [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.compute.manager [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing instance network info cache due to event network-changed-b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Acquiring lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Acquired lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Refreshing network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:03 user nova-compute[82394]: INFO nova.compute.manager [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Terminating instance
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updated VIF entry in instance network info cache for port b796ef8b-d964-459f-b12c-9be0133dd643. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:37:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [{"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Releasing lock "refresh_cache-19cc71e1-9b01-4bfd-9898-14b04bfe5fff" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Instance destroyed successfully.
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'resources' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1609521830',display_name='tempest-TestShelveInstance-server-1609521830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1609521830',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAGdsPc2kkKFJoMoObq2mhf3wSWiVrIpEKF85Yl7zW57cuaGGXxZfMd81KN/RMSzVQbf9duu6jwp+9gjp4UDunIsZZRYk1GjUolkdqpAK7Qa3hIBA+9wz/IhHmwfXa5Kg==',key_name='tempest-TestShelveInstance-382306594',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7bc7149e49343889c32fc198b6a0500',ramdisk_id='',reservation_id='r-33zyofsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-431446894',owner_user_name='tempest-TestShelveInstance-431446894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:35:25Z,user_data=None,user_id='391e2cd0c34b4e838c4cf86ba933270c',uuid=19cc71e1-9b01-4bfd-9898-14b04bfe5fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converting VIF {"id": "b796ef8b-d964-459f-b12c-9be0133dd643", "address": "fa:16:3e:7e:89:9d", "network": {"id": "4ae2039c-a02a-41d7-bd01-139981504845", "bridge": "br-int", "label": "tempest-TestShelveInstance-976046495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7bc7149e49343889c32fc198b6a0500", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb796ef8b-d9", "ovs_interfaceid": "b796ef8b-d964-459f-b12c-9be0133dd643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_vif [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb796ef8b-d9, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:37:04 user nova-compute[82394]: INFO os_vif [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:89:9d,bridge_name='br-int',has_traffic_filtering=True,id=b796ef8b-d964-459f-b12c-9be0133dd643,network=Network(4ae2039c-a02a-41d7-bd01-139981504845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb796ef8b-d9')
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEmcGxDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:37:04 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd34f0-ffcd-4c45-93c3-4069bb2ded76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:37:04 user nova-compute[82394]: No targets found.
Apr 12 00:37:04 user nova-compute[82394]: iSNS:
Apr 12 00:37:04 user nova-compute[82394]: No targets found.
Apr 12 00:37:04 user nova-compute[82394]: STATIC:
Apr 12 00:37:04 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:37:04 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:04 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:04 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:37:04 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:04 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:04 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:37:04 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:04 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:04 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:37:04 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:04 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:04 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb
Apr 12 00:37:04 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:04 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:04 user nova-compute[82394]: FIRMWARE:
Apr 12 00:37:04 user nova-compute[82394]: No targets found.
Apr 12 00:37:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:37:04 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:37:04 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f8ba7-56df-4fcb-80d5-ad331b491ccc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a6a7f-103d-48d8-b4bd-01ee0f3e2e07]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:04 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347c7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a68fc-b3c0-4871-9fe4-4fe6fc9adec7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb4408-ac19-4343-8f10-ddf39dfff492]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ab7e4-6d9f-470f-9e17-9d10aa09670e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d916cc4-4380-4763-8df7-aea95220ab10]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ec694-3e52-453c-a02f-8892d4cd9862]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea218ac-b408-47d5-8ae3-a00ccf8d7e5f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260]
Apr 12 00:37:04 user nova-compute[82394]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb, portal: 172.16.0.220,3260] successful.
Apr 12 00:37:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0a089d-f950-4c30-a68f-7511646878fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7d0ce-4a4d-4a90-94b2-03ce35ee149a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] <== disconnect_volume: return (361ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:37:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deleting instance files /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff_del
Apr 12 00:37:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deletion of /opt/stack/data/nova/instances/19cc71e1-9b01-4bfd-9898-14b04bfe5fff_del complete
Apr 12 00:37:04 user nova-compute[82394]: INFO nova.compute.manager [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 00:37:04 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:37:04 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:05 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Took 0.53 seconds to deallocate network for instance.
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-deleted-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-changed-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing instance network info cache due to event network-changed-f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Acquiring lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Acquired lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Refreshing network info cache for port f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:05 user nova-compute[82394]: INFO nova.compute.manager [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Terminating instance
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-unplugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Acquiring lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] No waiting events found dispatching network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:05 user nova-compute[82394]: WARNING nova.compute.manager [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Received unexpected event network-vif-plugged-b796ef8b-d964-459f-b12c-9be0133dd643 for instance with vm_state active and task_state deleting.
Apr 12 00:37:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updated VIF entry in instance network info cache for port f0e98861-35b6-489e-9f17-463054e69601. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:37:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating instance_info_cache with network_info: [{"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Releasing lock "refresh_cache-6c1ae397-d28d-4143-9aa1-cf00e799f9b5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.compute.manager [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Deleting volume: 8d0a089d-f950-4c30-a68f-7511646878fb {{(pid=82394) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Instance destroyed successfully.
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.objects.instance [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'resources' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1092112857',display_name='tempest-TestStampPattern-server-1092112857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1092112857',id=17,image_ref='1477c510-1b10-4162-b311-b1e0e3aeefda',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-tfsp4ml4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d25bc2e7-3399-47be-b78d-990acbb51749',image_min_disk='1',image_min_ram='0',image_owner_id='ca0ea21a2d4d400cba79444c68b58aed',image_owner_project_name='tempest-TestStampPattern-628358733',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-628358733-project-member',image_user_id='0e843a45549943cb88b1b3123a2fbe8a',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:34:22Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=6c1ae397-d28d-4143-9aa1-cf00e799f9b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "f0e98861-35b6-489e-9f17-463054e69601", "address": "fa:16:3e:6a:a6:53", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e98861-35", "ovs_interfaceid": "f0e98861-35b6-489e-9f17-463054e69601", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG os_vif [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0e98861-35, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:06 user nova-compute[82394]: INFO os_vif [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:a6:53,bridge_name='br-int',has_traffic_filtering=True,id=f0e98861-35b6-489e-9f17-463054e69601,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e98861-35')
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Deleting instance files /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5_del
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Deletion of /opt/stack/data/nova/instances/6c1ae397-d28d-4143-9aa1-cf00e799f9b5_del complete
Apr 12 00:37:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.compute.manager [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 00:37:06 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Deleted allocations for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff
Apr 12 00:37:06 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:06 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Took 0.54 seconds to deallocate network for instance.
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "19cc71e1-9b01-4bfd-9898-14b04bfe5fff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.436s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-vif-deleted-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-vif-unplugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] No waiting events found dispatching network-vif-unplugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:07 user nova-compute[82394]: WARNING nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received unexpected event network-vif-unplugged-f0e98861-35b6-489e-9f17-463054e69601 for instance with vm_state deleted and task_state None.
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Acquiring lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] No waiting events found dispatching network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:07 user nova-compute[82394]: WARNING nova.compute.manager [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Received unexpected event network-vif-plugged-f0e98861-35b6-489e-9f17-463054e69601 for instance with vm_state deleted and task_state None.
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:07 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Deleted allocations for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5
Apr 12 00:37:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "6c1ae397-d28d-4143-9aa1-cf00e799f9b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:19 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259824.3241315, 19cc71e1-9b01-4bfd-9898-14b04bfe5fff => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:19 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] VM Stopped (Lifecycle Event)
Apr 12 00:37:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-423381e2-8a09-4c9e-acca-144ef61cdc6c None None] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:21 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259826.2747831, 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:21 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] VM Stopped (Lifecycle Event)
Apr 12 00:37:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-656e9136-0bb4-4595-8de6-f92507d2a425 None None] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:37:34 user nova-compute[82394]: INFO nova.compute.claims [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Claim successful on node user
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:37:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:37:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:37:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Creating image(s)
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "/opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "/opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "/opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.policy [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7724cf4de81c4147929f43fd8744e8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6cebaed9654692bd9aef950a08741b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.164s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk 1073741824" returned: 0 in 0.060s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:35 user nova-compute[82394]: INFO nova.compute.manager [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Terminating instance
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing instance network info cache due to event network-changed-71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Acquiring lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Acquired lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.network.neutron [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Refreshing network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.164s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Cannot resize image /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lazy-loading 'migration_context' on Instance uuid daa798af-8437-4083-b73c-92b0cb39d861 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Ensure instance console log exists: /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Instance destroyed successfully.
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid ba310127-67a9-4245-87f6-555e35f30a16 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-410164590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-410164590',id=21,image_ref='7a7cf27a-f1da-4da9-9e1f-94aab7e25de9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-030gmfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-726466832',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:36:01Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ba310127-67a9-4245-87f6-555e35f30a16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "903dfac0-8003-4008-b135-5da44763c9ff", "address": "fa:16:3e:fe:f1:3b", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903dfac0-80", "ovs_interfaceid": "903dfac0-8003-4008-b135-5da44763c9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_vif [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903dfac0-80, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:36 user nova-compute[82394]: INFO os_vif [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=903dfac0-8003-4008-b135-5da44763c9ff,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903dfac0-80')
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsaLgZAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:37:36 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce87a2b-f83b-47e5-a312-1c629fc65f5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:37:36 user nova-compute[82394]: No targets found.
Apr 12 00:37:36 user nova-compute[82394]: iSNS:
Apr 12 00:37:36 user nova-compute[82394]: No targets found.
Apr 12 00:37:36 user nova-compute[82394]: STATIC:
Apr 12 00:37:36 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:37:36 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:36 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:36 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:37:36 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:36 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:36 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e
Apr 12 00:37:36 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:36 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:36 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:37:36 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:37:36 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:37:36 user nova-compute[82394]: FIRMWARE:
Apr 12 00:37:36 user nova-compute[82394]: No targets found.
Apr 12 00:37:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:37:36 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:37:36 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb973f5d-4f4a-474e-94e9-8656d4110f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab9e2c-221d-47fb-a7c8-baf094b2ad63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:37:36 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:37:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343cf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e'): ({'sde'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sde {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75289c8-e07c-4910-8e86-825a34ecefbb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8412594-c940-464f-a6d2-3d4e3382edea]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sde {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[454550b1-ba0e-4655-bdf8-296db5e08c26]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.network.neutron [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updated VIF entry in instance network info cache for port 71a3bef9-13f4-4aab-ba85-a26faa225efb. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.network.neutron [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating instance_info_cache with network_info: [{"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Releasing lock "refresh_cache-9d67708d-1bcf-4d32-8d45-22376ec72e34" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe973301-7161-471b-93c1-5ec76bc5e830]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26435386537343430', '/dev/disk/by-id/scsi-1SCST_BIOb38c6662-d58e7440c86d8265', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b38c6662') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:37:36 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26435386537343430
Apr 12 00:37:36 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb38c6662-d58e7440c86d8265
Apr 12 00:37:36 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b38c6662
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[224096c4-e029-43b1-ab0b-bfccf2a324ed]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204f14a-4c99-4804-96f1-dd9527e96924]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb12ea8-9149-4bb5-8794-1beb6b656ec3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260]
Apr 12 00:37:36 user nova-compute[82394]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e, portal: 172.16.0.220,3260] successful.
Apr 12 00:37:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ec9af9-0e26-4738-928f-8a4c475a856e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d212e782-b86e-488f-a41f-421606b295dd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (345ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:37:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Deleting instance files /opt/stack/data/nova/instances/ba310127-67a9-4245-87f6-555e35f30a16_del
Apr 12 00:37:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Deletion of /opt/stack/data/nova/instances/ba310127-67a9-4245-87f6-555e35f30a16_del complete
Apr 12 00:37:36 user nova-compute[82394]: INFO nova.compute.manager [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 00:37:36 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:37:36 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Successfully created port: 204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-deleted-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:37 user nova-compute[82394]: INFO nova.compute.manager [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Neutron deleted interface 903dfac0-8003-4008-b135-5da44763c9ff; detaching it from the instance and deleting it from the info cache
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.network.neutron [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:37 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Took 0.78 seconds to deallocate network for instance.
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Detach interface failed, port_id=903dfac0-8003-4008-b135-5da44763c9ff, reason: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-unplugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] No waiting events found dispatching network-vif-unplugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-unplugged-903dfac0-8003-4008-b135-5da44763c9ff for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Acquiring lock "ba310127-67a9-4245-87f6-555e35f30a16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "ba310127-67a9-4245-87f6-555e35f30a16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] No waiting events found dispatching network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:37 user nova-compute[82394]: WARNING nova.compute.manager [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Received unexpected event network-vif-plugged-903dfac0-8003-4008-b135-5da44763c9ff for instance with vm_state active and task_state deleting.
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:37 user nova-compute[82394]: INFO nova.compute.manager [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Terminating instance
Apr 12 00:37:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Successfully updated port: 204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquired lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Updating instance_info_cache with network_info: [{"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:38 user nova-compute[82394]: INFO nova.compute.manager [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Took 0.91 seconds to detach 1 volumes for instance.
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Deleting volume: c7ec9af9-0e26-4738-928f-8a4c475a856e {{(pid=82394) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Releasing lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Instance network_info: |[{"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Start _get_guest_xml network_info=[{"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:37:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:38 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-752173567',display_name='tempest-VolumesNegativeTest-instance-752173567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-752173567',id=24,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6cebaed9654692bd9aef950a08741b',ramdisk_id='',reservation_id='r-70p2oftm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-791919853',owner_user_name='tempest-VolumesNegativeTest-791919853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:37:35Z,user_data=None,user_id='7724cf4de81c4147929f43fd8744e8f9',uuid=daa798af-8437-4083-b73c-92b0cb39d861,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converting VIF {"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lazy-loading 'pci_devices' on Instance uuid daa798af-8437-4083-b73c-92b0cb39d861 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:37:38 user nova-compute[82394]:   <uuid>daa798af-8437-4083-b73c-92b0cb39d861</uuid>
Apr 12 00:37:38 user nova-compute[82394]:   <name>instance-00000018</name>
Apr 12 00:37:38 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:37:38 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:37:38 user nova-compute[82394]:   <metadata>
Apr 12 00:37:38 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:37:38 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:name>tempest-VolumesNegativeTest-instance-752173567</nova:name>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:37:38</nova:creationTime>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:37:38 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:37:38 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:owner>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:user uuid="7724cf4de81c4147929f43fd8744e8f9">tempest-VolumesNegativeTest-791919853-project-member</nova:user>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:project uuid="4d6cebaed9654692bd9aef950a08741b">tempest-VolumesNegativeTest-791919853</nova:project>
Apr 12 00:37:38 user nova-compute[82394]:       </nova:owner>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:37:38 user nova-compute[82394]:       <nova:ports>
Apr 12 00:37:38 user nova-compute[82394]:         <nova:port uuid="204e9845-040e-4b8d-a957-b70dd44b340b">
Apr 12 00:37:38 user nova-compute[82394]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
Apr 12 00:37:38 user nova-compute[82394]:         </nova:port>
Apr 12 00:37:38 user nova-compute[82394]:       </nova:ports>
Apr 12 00:37:38 user nova-compute[82394]:     </nova:instance>
Apr 12 00:37:38 user nova-compute[82394]:   </metadata>
Apr 12 00:37:38 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:37:38 user nova-compute[82394]:     <system>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="serial">daa798af-8437-4083-b73c-92b0cb39d861</entry>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="uuid">daa798af-8437-4083-b73c-92b0cb39d861</entry>
Apr 12 00:37:38 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:37:38 user nova-compute[82394]:     </system>
Apr 12 00:37:38 user nova-compute[82394]:   </sysinfo>
Apr 12 00:37:38 user nova-compute[82394]:   <os>
Apr 12 00:37:38 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:37:38 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:37:38 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:37:38 user nova-compute[82394]:   </os>
Apr 12 00:37:38 user nova-compute[82394]:   <features>
Apr 12 00:37:38 user nova-compute[82394]:     <acpi/>
Apr 12 00:37:38 user nova-compute[82394]:     <apic/>
Apr 12 00:37:38 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:37:38 user nova-compute[82394]:   </features>
Apr 12 00:37:38 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:37:38 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:37:38 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:37:38 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:37:38 user nova-compute[82394]:   </clock>
Apr 12 00:37:38 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:37:38 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:37:38 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:37:38 user nova-compute[82394]:   </cpu>
Apr 12 00:37:38 user nova-compute[82394]:   <devices>
Apr 12 00:37:38 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:37:38 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:37:38 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk"/>
Apr 12 00:37:38 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:37:38 user nova-compute[82394]:     </disk>
Apr 12 00:37:38 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:37:38 user nova-compute[82394]:       <mac address="fa:16:3e:56:fe:df"/>
Apr 12 00:37:38 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:37:38 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:37:38 user nova-compute[82394]:       <target dev="tap204e9845-04"/>
Apr 12 00:37:38 user nova-compute[82394]:     </interface>
Apr 12 00:37:38 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:37:38 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/console.log" append="off"/>
Apr 12 00:37:38 user nova-compute[82394]:     </serial>
Apr 12 00:37:38 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:37:38 user nova-compute[82394]:     <video>
Apr 12 00:37:38 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:37:38 user nova-compute[82394]:     </video>
Apr 12 00:37:38 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:37:38 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:37:38 user nova-compute[82394]:     </rng>
Apr 12 00:37:38 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:37:38 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:37:38 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:37:38 user nova-compute[82394]:     </memballoon>
Apr 12 00:37:38 user nova-compute[82394]:   </devices>
Apr 12 00:37:38 user nova-compute[82394]: </domain>
Apr 12 00:37:38 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-752173567',display_name='tempest-VolumesNegativeTest-instance-752173567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-752173567',id=24,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d6cebaed9654692bd9aef950a08741b',ramdisk_id='',reservation_id='r-70p2oftm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-791919853',owner_user_name='tempest-VolumesNegativeTest-791919853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:37:35Z,user_data=None,user_id='7724cf4de81c4147929f43fd8744e8f9',uuid=daa798af-8437-4083-b73c-92b0cb39d861,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converting VIF {"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG os_vif [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap204e9845-04, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap204e9845-04, col_values=(('external_ids', {'iface-id': '204e9845-040e-4b8d-a957-b70dd44b340b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fe:df', 'vm-uuid': 'daa798af-8437-4083-b73c-92b0cb39d861'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:38 user nova-compute[82394]: INFO os_vif [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04')
Apr 12 00:37:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] No VIF found with MAC fa:16:3e:56:fe:df, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:38 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Instance destroyed successfully.
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.objects.instance [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'resources' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234273224',display_name='tempest-SnapshotDataIntegrityTests-server-234273224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234273224',id=12,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP1c5/DXHZ03s6Jdn9okYMn378SHeUgFUdyzdwxHtCPGziXx0bIkFiht3GzYK2UQV1ksfRO+sxkDOUgz1Da1rC/+VwIe2/nk+J4nKbMkEnpWPIkQxI6eGb5x1NRAtYWkw==',key_name='tempest-SnapshotDataIntegrityTests-1604911239',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12eca8b17b844a8821294ec9dd19de8',ramdisk_id='',reservation_id='r-50ifr5ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-282769033',owner_user_name='tempest-SnapshotDataIntegrityTests-282769033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:33Z,user_data=None,user_id='c5219586e4e24c33a8cdf52c21d875bd',uuid=9d67708d-1bcf-4d32-8d45-22376ec72e34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converting VIF {"id": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "address": "fa:16:3e:ad:aa:95", "network": {"id": "74d37a9a-7159-40ca-818e-746e6ff2534f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1791607723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12eca8b17b844a8821294ec9dd19de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71a3bef9-13", "ovs_interfaceid": "71a3bef9-13f4-4aab-ba85-a26faa225efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG os_vif [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71a3bef9-13, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:39 user nova-compute[82394]: INFO os_vif [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:aa:95,bridge_name='br-int',has_traffic_filtering=True,id=71a3bef9-13f4-4aab-ba85-a26faa225efb,network=Network(74d37a9a-7159-40ca-818e-746e6ff2534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71a3bef9-13')
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Deleting instance files /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34_del
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Deletion of /opt/stack/data/nova/instances/9d67708d-1bcf-4d32-8d45-22376ec72e34_del complete
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance ba310127-67a9-4245-87f6-555e35f30a16
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.compute.manager [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ba310127-67a9-4245-87f6-555e35f30a16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.599s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-changed-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Refreshing instance network info cache due to event network-changed-204e9845-040e-4b8d-a957-b70dd44b340b. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Acquiring lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Acquired lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.network.neutron [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Refreshing network info cache for port 204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-unplugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] No waiting events found dispatching network-vif-unplugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-unplugged-71a3bef9-13f4-4aab-ba85-a26faa225efb for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Acquiring lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] No waiting events found dispatching network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:39 user nova-compute[82394]: WARNING nova.compute.manager [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received unexpected event network-vif-plugged-71a3bef9-13f4-4aab-ba85-a26faa225efb for instance with vm_state active and task_state deleting.
Apr 12 00:37:39 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:39 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Took 0.70 seconds to deallocate network for instance.
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.network.neutron [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Updated VIF entry in instance network info cache for port 204e9845-040e-4b8d-a957-b70dd44b340b. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.network.neutron [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Updating instance_info_cache with network_info: [{"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Releasing lock "refresh_cache-daa798af-8437-4083-b73c-92b0cb39d861" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:40 user nova-compute[82394]: WARNING nova.compute.manager [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state building and task_state spawning.
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:40 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Deleted allocations for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34
Apr 12 00:37:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "9d67708d-1bcf-4d32-8d45-22376ec72e34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Received event network-vif-deleted-71a3bef9-13f4-4aab-ba85-a26faa225efb {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259862.2419696, daa798af-8437-4083-b73c-92b0cb39d861 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] VM Resumed (Lifecycle Event)
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Instance spawned successfully.
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259862.2431278, daa798af-8437-4083-b73c-92b0cb39d861 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] VM Started (Lifecycle Event)
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Took 7.24 seconds to spawn the instance on the hypervisor.
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:42 user nova-compute[82394]: WARNING nova.compute.manager [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state building and task_state spawning.
Apr 12 00:37:42 user nova-compute[82394]: INFO nova.compute.manager [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Took 8.05 seconds to build instance.
Apr 12 00:37:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.148s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:44 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:37:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259856.3163607, ba310127-67a9-4245-87f6-555e35f30a16 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:51 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ba310127-67a9-4245-87f6-555e35f30a16] VM Stopped (Lifecycle Event)
Apr 12 00:37:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-cd6c4af1-1cab-4d0b-a3d5-93c72e412a03 None None] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:37:52 user nova-compute[82394]: INFO nova.compute.claims [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Claim successful on node user
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:37:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:37:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Creating image(s)
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "/opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "/opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.policy [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259859.0067275, 9d67708d-1bcf-4d32-8d45-22376ec72e34 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:37:54 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] VM Stopped (Lifecycle Event)
Apr 12 00:37:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-337ddd9e-0822-437c-8a7e-573cb2af90ab None None] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.163s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk 1073741824" returned: 0 in 0.054s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Cannot resize image /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.objects.instance [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'migration_context' on Instance uuid f2164441-0fa4-463c-afde-a333095d0e56 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Ensure instance console log exists: /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Successfully created port: 6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Successfully updated port: 6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquired lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-changed-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Refreshing instance network info cache due to event network-changed-6b36ad5a-353d-438b-95d1-fddbcfe01e2c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Acquiring lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:37:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Updating instance_info_cache with network_info: [{"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=26.340763092041016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Releasing lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Instance network_info: |[{"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Acquired lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Refreshing network info cache for port 6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Start _get_guest_xml network_info=[{"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980059856',display_name='tempest-VolumesAdminNegativeTest-server-980059856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980059856',id=25,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-ndv0mwq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:37:54Z,user_data=None,user_id='c276268b63084515a43caa837af30fb1',uuid=f2164441-0fa4-463c-afde-a333095d0e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'pci_devices' on Instance uuid f2164441-0fa4-463c-afde-a333095d0e56 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:37:56 user nova-compute[82394]:   <uuid>f2164441-0fa4-463c-afde-a333095d0e56</uuid>
Apr 12 00:37:56 user nova-compute[82394]:   <name>instance-00000019</name>
Apr 12 00:37:56 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:37:56 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:37:56 user nova-compute[82394]:   <metadata>
Apr 12 00:37:56 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:37:56 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:name>tempest-VolumesAdminNegativeTest-server-980059856</nova:name>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:37:56</nova:creationTime>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:37:56 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:37:56 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:owner>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:user uuid="c276268b63084515a43caa837af30fb1">tempest-VolumesAdminNegativeTest-1593136751-project-member</nova:user>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:project uuid="a8c1003f0d1847b7b4c679b0f7cc3110">tempest-VolumesAdminNegativeTest-1593136751</nova:project>
Apr 12 00:37:56 user nova-compute[82394]:       </nova:owner>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:37:56 user nova-compute[82394]:       <nova:ports>
Apr 12 00:37:56 user nova-compute[82394]:         <nova:port uuid="6b36ad5a-353d-438b-95d1-fddbcfe01e2c">
Apr 12 00:37:56 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 00:37:56 user nova-compute[82394]:         </nova:port>
Apr 12 00:37:56 user nova-compute[82394]:       </nova:ports>
Apr 12 00:37:56 user nova-compute[82394]:     </nova:instance>
Apr 12 00:37:56 user nova-compute[82394]:   </metadata>
Apr 12 00:37:56 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:37:56 user nova-compute[82394]:     <system>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="serial">f2164441-0fa4-463c-afde-a333095d0e56</entry>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="uuid">f2164441-0fa4-463c-afde-a333095d0e56</entry>
Apr 12 00:37:56 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:37:56 user nova-compute[82394]:     </system>
Apr 12 00:37:56 user nova-compute[82394]:   </sysinfo>
Apr 12 00:37:56 user nova-compute[82394]:   <os>
Apr 12 00:37:56 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:37:56 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:37:56 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:37:56 user nova-compute[82394]:   </os>
Apr 12 00:37:56 user nova-compute[82394]:   <features>
Apr 12 00:37:56 user nova-compute[82394]:     <acpi/>
Apr 12 00:37:56 user nova-compute[82394]:     <apic/>
Apr 12 00:37:56 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:37:56 user nova-compute[82394]:   </features>
Apr 12 00:37:56 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:37:56 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:37:56 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:37:56 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:37:56 user nova-compute[82394]:   </clock>
Apr 12 00:37:56 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:37:56 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:37:56 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:37:56 user nova-compute[82394]:   </cpu>
Apr 12 00:37:56 user nova-compute[82394]:   <devices>
Apr 12 00:37:56 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:37:56 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:37:56 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk"/>
Apr 12 00:37:56 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:37:56 user nova-compute[82394]:     </disk>
Apr 12 00:37:56 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:37:56 user nova-compute[82394]:       <mac address="fa:16:3e:97:32:f3"/>
Apr 12 00:37:56 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:37:56 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:37:56 user nova-compute[82394]:       <target dev="tap6b36ad5a-35"/>
Apr 12 00:37:56 user nova-compute[82394]:     </interface>
Apr 12 00:37:56 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:37:56 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/console.log" append="off"/>
Apr 12 00:37:56 user nova-compute[82394]:     </serial>
Apr 12 00:37:56 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:37:56 user nova-compute[82394]:     <video>
Apr 12 00:37:56 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:37:56 user nova-compute[82394]:     </video>
Apr 12 00:37:56 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:37:56 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:37:56 user nova-compute[82394]:     </rng>
Apr 12 00:37:56 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:37:56 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:37:56 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:37:56 user nova-compute[82394]:     </memballoon>
Apr 12 00:37:56 user nova-compute[82394]:   </devices>
Apr 12 00:37:56 user nova-compute[82394]: </domain>
Apr 12 00:37:56 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980059856',display_name='tempest-VolumesAdminNegativeTest-server-980059856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980059856',id=25,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-ndv0mwq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:37:54Z,user_data=None,user_id='c276268b63084515a43caa837af30fb1',uuid=f2164441-0fa4-463c-afde-a333095d0e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG os_vif [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b36ad5a-35, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b36ad5a-35, col_values=(('external_ids', {'iface-id': '6b36ad5a-353d-438b-95d1-fddbcfe01e2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:32:f3', 'vm-uuid': 'f2164441-0fa4-463c-afde-a333095d0e56'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:56 user nova-compute[82394]: INFO os_vif [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35')
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d25bc2e7-3399-47be-b78d-990acbb51749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d8833bad-d30f-4cd4-aa66-10d60c782061 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance daa798af-8437-4083-b73c-92b0cb39d861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f2164441-0fa4-463c-afde-a333095d0e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] No VIF found with MAC fa:16:3e:97:32:f3, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:37:56 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Updated VIF entry in instance network info cache for port 6b36ad5a-353d-438b-95d1-fddbcfe01e2c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Updating instance_info_cache with network_info: [{"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Releasing lock "refresh_cache-f2164441-0fa4-463c-afde-a333095d0e56" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:37:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] No waiting events found dispatching network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:37:58 user nova-compute[82394]: WARNING nova.compute.manager [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received unexpected event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance with vm_state building and task_state spawning.
Apr 12 00:37:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259880.147705, f2164441-0fa4-463c-afde-a333095d0e56 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] VM Resumed (Lifecycle Event)
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Instance spawned successfully.
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259880.1492288, f2164441-0fa4-463c-afde-a333095d0e56 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] VM Started (Lifecycle Event)
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing instance network info cache due to event network-changed-7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Acquiring lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Acquired lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Refreshing network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Took 7.45 seconds to build instance.
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:00 user nova-compute[82394]: INFO nova.compute.manager [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Terminating instance
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.579s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] No waiting events found dispatching network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:00 user nova-compute[82394]: WARNING nova.compute.manager [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received unexpected event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance with vm_state active and task_state None.
Apr 12 00:38:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Instance destroyed successfully.
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'resources' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1196189311',display_name='tempest-TestStampPattern-server-1196189311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1196189311',id=11,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A==',key_name='tempest-TestStampPattern-1883128824',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca0ea21a2d4d400cba79444c68b58aed',ramdisk_id='',reservation_id='r-5hnlks40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-628358733',owner_user_name='tempest-TestStampPattern-628358733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:34:06Z,user_data=None,user_id='0e843a45549943cb88b1b3123a2fbe8a',uuid=d25bc2e7-3399-47be-b78d-990acbb51749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converting VIF {"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG os_vif [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f434880-80, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:38:01 user nova-compute[82394]: INFO os_vif [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:62:29,bridge_name='br-int',has_traffic_filtering=True,id=7f434880-804b-43da-b1ab-5d5e05b5bee1,network=Network(193a75a6-a349-4ef2-9598-e9d4b3c476c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f434880-80')
Apr 12 00:38:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Deleting instance files /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749_del
Apr 12 00:38:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Deletion of /opt/stack/data/nova/instances/d25bc2e7-3399-47be-b78d-990acbb51749_del complete
Apr 12 00:38:01 user nova-compute[82394]: INFO nova.compute.manager [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 00:38:01 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updated VIF entry in instance network info cache for port 7f434880-804b-43da-b1ab-5d5e05b5bee1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.neutron [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating instance_info_cache with network_info: [{"id": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "address": "fa:16:3e:15:62:29", "network": {"id": "193a75a6-a349-4ef2-9598-e9d4b3c476c4", "bridge": "br-int", "label": "tempest-TestStampPattern-209146692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca0ea21a2d4d400cba79444c68b58aed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f434880-80", "ovs_interfaceid": "7f434880-804b-43da-b1ab-5d5e05b5bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Releasing lock "refresh_cache-d25bc2e7-3399-47be-b78d-990acbb51749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:01 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Took 0.55 seconds to deallocate network for instance.
Apr 12 00:38:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-vif-deleted-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-vif-unplugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] No waiting events found dispatching network-vif-unplugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:02 user nova-compute[82394]: WARNING nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received unexpected event network-vif-unplugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance with vm_state deleted and task_state None.
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Acquiring lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "d25bc2e7-3399-47be-b78d-990acbb51749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] No waiting events found dispatching network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:02 user nova-compute[82394]: WARNING nova.compute.manager [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Received unexpected event network-vif-plugged-7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance with vm_state deleted and task_state None.
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:02 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Deleted allocations for instance d25bc2e7-3399-47be-b78d-990acbb51749
Apr 12 00:38:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "d25bc2e7-3399-47be-b78d-990acbb51749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.084s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-changed-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Refreshing instance network info cache due to event network-changed-4e105e43-5ee4-46ca-a01a-be1a58096a0a. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Acquiring lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Acquired lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:06 user nova-compute[82394]: DEBUG nova.network.neutron [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Refreshing network info cache for port 4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:38:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updated VIF entry in instance network info cache for port 4e105e43-5ee4-46ca-a01a-be1a58096a0a. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:38:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updating instance_info_cache with network_info: [{"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Releasing lock "refresh_cache-8fd7bb9c-9e20-49f2-8848-162a784b9885" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:08 user nova-compute[82394]: INFO nova.compute.manager [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Terminating instance
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Instance destroyed successfully.
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'resources' on Instance uuid 8fd7bb9c-9e20-49f2-8848-162a784b9885 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-267379931',display_name='tempest-AttachVolumeNegativeTest-server-267379931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-267379931',id=22,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHLuxBkm6l01yjTwTdI1oiZ9aYwN/CnkMAfV6gxx8VJgA1NcUdSBeVuPz9wX3aWjmvtFSrqyDF/6dJS/nZiFNgFQ/beyg+GrmUzZrVy2Dcklya2DeprEvo0CkCYCFDqXA==',key_name='tempest-keypair-665321536',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-4oium4vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:36:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=8fd7bb9c-9e20-49f2-8848-162a784b9885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "address": "fa:16:3e:05:d1:b3", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e105e43-5e", "ovs_interfaceid": "4e105e43-5ee4-46ca-a01a-be1a58096a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG os_vif [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e105e43-5e, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:08 user nova-compute[82394]: INFO os_vif [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:d1:b3,bridge_name='br-int',has_traffic_filtering=True,id=4e105e43-5ee4-46ca-a01a-be1a58096a0a,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e105e43-5e')
Apr 12 00:38:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Deleting instance files /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885_del
Apr 12 00:38:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Deletion of /opt/stack/data/nova/instances/8fd7bb9c-9e20-49f2-8848-162a784b9885_del complete
Apr 12 00:38:08 user nova-compute[82394]: INFO nova.compute.manager [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-unplugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] No waiting events found dispatching network-vif-unplugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-unplugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Acquiring lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] No waiting events found dispatching network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:08 user nova-compute[82394]: WARNING nova.compute.manager [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received unexpected event network-vif-plugged-4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance with vm_state active and task_state deleting.
Apr 12 00:38:10 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:10 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Took 1.19 seconds to deallocate network for instance.
Apr 12 00:38:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:10 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:10 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:10 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Deleted allocations for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885
Apr 12 00:38:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "8fd7bb9c-9e20-49f2-8848-162a784b9885" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Received event network-vif-deleted-4e105e43-5ee4-46ca-a01a-be1a58096a0a {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:16 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259881.1417646, d25bc2e7-3399-47be-b78d-990acbb51749 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:16 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] VM Stopped (Lifecycle Event)
Apr 12 00:38:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-60a1478c-3f82-45fc-90a9-c2daba54dcad None None] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:38:19 user nova-compute[82394]: INFO nova.compute.claims [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Claim successful on node user
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:38:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.policy [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:38:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Creating image(s)
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk 1073741824" returned: 0 in 0.051s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Cannot resize image /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Successfully created port: a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Ensure instance console log exists: /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Successfully updated port: a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing instance network info cache due to event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance network_info: |[{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start _get_guest_xml network_info=[{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:38:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1581384647',display_name='tempest-ServerRescueNegativeTestJSON-server-1581384647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1581384647',id=26,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcEUBZp/r0Qr+iXZ7VL0L/sg/DlCeGc9XiO7Mbog1Rn8MLmZsv660DZ2ywYiThGWPYBU7SmwQ5EYhiLYCMFIdiItGknXyBfY++d6oZR6/JM9QXgkOzqORWBqeFGCztcw==',key_name='tempest-keypair-936664235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-b6l1ni5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b9421443b2f421298a934122c6a8b8c',uuid=49c8e8b7-1f91-4cf5-a222-c787a186444d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:38:21 user nova-compute[82394]:   <uuid>49c8e8b7-1f91-4cf5-a222-c787a186444d</uuid>
Apr 12 00:38:21 user nova-compute[82394]:   <name>instance-0000001a</name>
Apr 12 00:38:21 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:38:21 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:38:21 user nova-compute[82394]:   <metadata>
Apr 12 00:38:21 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:38:21 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1581384647</nova:name>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:38:21</nova:creationTime>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:38:21 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:38:21 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:owner>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:38:21 user nova-compute[82394]:       </nova:owner>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:38:21 user nova-compute[82394]:       <nova:ports>
Apr 12 00:38:21 user nova-compute[82394]:         <nova:port uuid="a2a25522-be49-4ac7-9893-d030dc2d87ab">
Apr 12 00:38:21 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:38:21 user nova-compute[82394]:         </nova:port>
Apr 12 00:38:21 user nova-compute[82394]:       </nova:ports>
Apr 12 00:38:21 user nova-compute[82394]:     </nova:instance>
Apr 12 00:38:21 user nova-compute[82394]:   </metadata>
Apr 12 00:38:21 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:38:21 user nova-compute[82394]:     <system>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="serial">49c8e8b7-1f91-4cf5-a222-c787a186444d</entry>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="uuid">49c8e8b7-1f91-4cf5-a222-c787a186444d</entry>
Apr 12 00:38:21 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:38:21 user nova-compute[82394]:     </system>
Apr 12 00:38:21 user nova-compute[82394]:   </sysinfo>
Apr 12 00:38:21 user nova-compute[82394]:   <os>
Apr 12 00:38:21 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:38:21 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:38:21 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:38:21 user nova-compute[82394]:   </os>
Apr 12 00:38:21 user nova-compute[82394]:   <features>
Apr 12 00:38:21 user nova-compute[82394]:     <acpi/>
Apr 12 00:38:21 user nova-compute[82394]:     <apic/>
Apr 12 00:38:21 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:38:21 user nova-compute[82394]:   </features>
Apr 12 00:38:21 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:38:21 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:38:21 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:38:21 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:38:21 user nova-compute[82394]:   </clock>
Apr 12 00:38:21 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:38:21 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:38:21 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:38:21 user nova-compute[82394]:   </cpu>
Apr 12 00:38:21 user nova-compute[82394]:   <devices>
Apr 12 00:38:21 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:38:21 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:38:21 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk"/>
Apr 12 00:38:21 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:38:21 user nova-compute[82394]:     </disk>
Apr 12 00:38:21 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:38:21 user nova-compute[82394]:       <mac address="fa:16:3e:ce:56:00"/>
Apr 12 00:38:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:21 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:38:21 user nova-compute[82394]:       <target dev="tapa2a25522-be"/>
Apr 12 00:38:21 user nova-compute[82394]:     </interface>
Apr 12 00:38:21 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:38:21 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/console.log" append="off"/>
Apr 12 00:38:21 user nova-compute[82394]:     </serial>
Apr 12 00:38:21 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:38:21 user nova-compute[82394]:     <video>
Apr 12 00:38:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:21 user nova-compute[82394]:     </video>
Apr 12 00:38:21 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:38:21 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:38:21 user nova-compute[82394]:     </rng>
Apr 12 00:38:21 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:38:21 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:38:21 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:38:21 user nova-compute[82394]:     </memballoon>
Apr 12 00:38:21 user nova-compute[82394]:   </devices>
Apr 12 00:38:21 user nova-compute[82394]: </domain>
Apr 12 00:38:21 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1581384647',display_name='tempest-ServerRescueNegativeTestJSON-server-1581384647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1581384647',id=26,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcEUBZp/r0Qr+iXZ7VL0L/sg/DlCeGc9XiO7Mbog1Rn8MLmZsv660DZ2ywYiThGWPYBU7SmwQ5EYhiLYCMFIdiItGknXyBfY++d6oZR6/JM9QXgkOzqORWBqeFGCztcw==',key_name='tempest-keypair-936664235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-b6l1ni5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b9421443b2f421298a934122c6a8b8c',uuid=49c8e8b7-1f91-4cf5-a222-c787a186444d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG os_vif [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2a25522-be, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2a25522-be, col_values=(('external_ids', {'iface-id': 'a2a25522-be49-4ac7-9893-d030dc2d87ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:56:00', 'vm-uuid': '49c8e8b7-1f91-4cf5-a222-c787a186444d'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:21 user nova-compute[82394]: INFO os_vif [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be')
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:ce:56:00, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:38:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updated VIF entry in instance network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:38:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:23 user nova-compute[82394]: WARNING nova.compute.manager [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state building and task_state spawning.
Apr 12 00:38:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:23 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259888.8298845, 8fd7bb9c-9e20-49f2-8848-162a784b9885 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:23 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] VM Stopped (Lifecycle Event)
Apr 12 00:38:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4d694ccc-0cde-4b1f-9a2d-c436769a9bc8 None None] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:25 user nova-compute[82394]: WARNING nova.compute.manager [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state building and task_state spawning.
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259905.7297046, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Resumed (Lifecycle Event)
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance spawned successfully.
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259905.7300138, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Started (Lifecycle Event)
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Terminating instance
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Took 5.93 seconds to spawn the instance on the hypervisor.
Apr 12 00:38:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:25 user nova-compute[82394]: INFO nova.compute.manager [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Took 6.71 seconds to build instance.
Apr 12 00:38:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.815s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-unplugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] No waiting events found dispatching network-vif-unplugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-unplugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Instance destroyed successfully.
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.objects.instance [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lazy-loading 'resources' on Instance uuid ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1121770049',display_name='tempest-ServersNegativeTestJSON-server-1121770049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1121770049',id=1,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:30:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ee31cdc6f4e4c2b9a8ec1e1c5076010',ramdisk_id='',reservation_id='r-81fabj4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-103053763',owner_user_name='tempest-ServersNegativeTestJSON-103053763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:30:02Z,user_data=None,user_id='920d6d79e38e45fcb5153e712605764f',uuid=ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converting VIF {"id": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "address": "fa:16:3e:2a:b1:5d", "network": {"id": "4588d0e1-772f-4c76-b467-7e46031e477d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-999030602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ee31cdc6f4e4c2b9a8ec1e1c5076010", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc385c2b-9f", "ovs_interfaceid": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG os_vif [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc385c2b-9f, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:38:26 user nova-compute[82394]: INFO os_vif [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b1:5d,bridge_name='br-int',has_traffic_filtering=True,id=cc385c2b-9f16-4daf-a929-f3c9e133e5fa,network=Network(4588d0e1-772f-4c76-b467-7e46031e477d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc385c2b-9f')
Apr 12 00:38:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Deleting instance files /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9_del
Apr 12 00:38:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Deletion of /opt/stack/data/nova/instances/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9_del complete
Apr 12 00:38:26 user nova-compute[82394]: INFO nova.compute.manager [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 00:38:26 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:38:26 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:27 user nova-compute[82394]: INFO nova.compute.manager [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Terminating instance
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:38:27 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Took 0.68 seconds to deallocate network for instance.
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-unplugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] No waiting events found dispatching network-vif-unplugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-unplugged-5512329a-21f4-4114-b881-ede435da55c8 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:27 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Deleted allocations for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Instance destroyed successfully.
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid d8833bad-d30f-4cd4-aa66-10d60c782061 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Acquiring lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Lock "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] No waiting events found dispatching network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:28 user nova-compute[82394]: WARNING nova.compute.manager [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received unexpected event network-vif-plugged-cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance with vm_state deleted and task_state None.
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Received event network-vif-deleted-cc385c2b-9f16-4daf-a929-f3c9e133e5fa {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-84409472',display_name='tempest-TestVolumeBootPattern-volume-backed-server-84409472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-84409472',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-0r6j9vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:34:04Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=d8833bad-d30f-4cd4-aa66-10d60c782061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "5512329a-21f4-4114-b881-ede435da55c8", "address": "fa:16:3e:89:73:c0", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5512329a-21", "ovs_interfaceid": "5512329a-21f4-4114-b881-ede435da55c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_vif [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5512329a-21, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:38:28 user nova-compute[82394]: INFO os_vif [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:73:c0,bridge_name='br-int',has_traffic_filtering=True,id=5512329a-21f4-4114-b881-ede435da55c8,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5512329a-21')
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWUYElMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e626f-91a8-4f8a-a631-b2687ec0a5c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:38:28 user nova-compute[82394]: No targets found.
Apr 12 00:38:28 user nova-compute[82394]: iSNS:
Apr 12 00:38:28 user nova-compute[82394]: No targets found.
Apr 12 00:38:28 user nova-compute[82394]: STATIC:
Apr 12 00:38:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:38:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b
Apr 12 00:38:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:38:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:28 user nova-compute[82394]: FIRMWARE:
Apr 12 00:38:28 user nova-compute[82394]: No targets found.
Apr 12 00:38:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:38:28 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:38:28 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6eb8be-31ee-40ca-bad2-9e722b731ca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c93f91a-7fba-4151-9175-c7f9451709d5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:38:28 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:28 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b (non-flash)
Apr 12 00:38:28 user nova-compute[82394]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:28 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fd7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[774522f7-d9d8-4dab-b757-494acaa75593]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d690e04-8429-4d6d-8827-2f41014a921f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d2c05-a564-4e80-a801-1335f7d18177]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a94d2-fdfe-4c25-9c0c-95922b06ea0b]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO56d217b6-888dc43781dbe2ab', '/dev/disk/by-id/scsi-23838386463343337', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_56d217b6') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc89f7a-2172-4a02-818d-6ddafec0509a]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d652b54d-9c39-4943-974e-d587c9f99255]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119751d-eb6c-402f-8d84-9734ab8959ab]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260]
Apr 12 00:38:28 user nova-compute[82394]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b, portal: 172.16.0.220,3260] successful.
Apr 12 00:38:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca06330d-06f4-4f25-8449-2e03b021dc3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[28777aa0-078b-4798-ad91-2b3aa17d72b0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (320ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:38:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Deleting instance files /opt/stack/data/nova/instances/d8833bad-d30f-4cd4-aa66-10d60c782061_del
Apr 12 00:38:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Deletion of /opt/stack/data/nova/instances/d8833bad-d30f-4cd4-aa66-10d60c782061_del complete
Apr 12 00:38:28 user nova-compute[82394]: INFO nova.compute.manager [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 00:38:28 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:38:28 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:38:29 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:29 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Took 0.51 seconds to deallocate network for instance.
Apr 12 00:38:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Acquiring lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] No waiting events found dispatching network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:29 user nova-compute[82394]: WARNING nova.compute.manager [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received unexpected event network-vif-plugged-5512329a-21f4-4114-b881-ede435da55c8 for instance with vm_state active and task_state deleting.
Apr 12 00:38:29 user nova-compute[82394]: INFO nova.compute.manager [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Took 0.84 seconds to detach 1 volumes for instance.
Apr 12 00:38:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Deleting volume: ca06330d-06f4-4f25-8449-2e03b021dc3b {{(pid=82394) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:30 user nova-compute[82394]: INFO nova.compute.manager [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Rescuing
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Received event network-vif-deleted-5512329a-21f4-4114-b881-ede435da55c8 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:30 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance d8833bad-d30f-4cd4-aa66-10d60c782061
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "d8833bad-d30f-4cd4-aa66-10d60c782061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:31 user nova-compute[82394]: WARNING nova.compute.manager [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state active and task_state rescuing.
Apr 12 00:38:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance destroyed successfully.
Apr 12 00:38:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Attempting a stable device rescue
Apr 12 00:38:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:38:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Creating image(s)
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "15d09d2d162d7c61c2051e367ea199a179ef464a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "15d09d2d162d7c61c2051e367ea199a179ef464a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.part --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:32 user nova-compute[82394]: DEBUG nova.virt.images [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 6e4c1e91-eee3-4f24-9777-322df51a65d9 was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:38:32 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:38:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.part /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.part /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.converted" returned: 0 in 0.408s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:33 user nova-compute[82394]: WARNING nova.compute.manager [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state active and task_state rescuing.
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "15d09d2d162d7c61c2051e367ea199a179ef464a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.614s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "15d09d2d162d7c61c2051e367ea199a179ef464a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "15d09d2d162d7c61c2051e367ea199a179ef464a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a,backing_fmt=raw /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a,backing_fmt=raw /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue" returned: 0 in 0.053s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "15d09d2d162d7c61c2051e367ea199a179ef464a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'migration_context' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start _get_guest_xml network_info=[{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:84:89:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e4c1e91-eee3-4f24-9777-322df51a65d9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b673f43-481a-43c4-8563-ac28641ccda3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1277a40a-6389-4d88-bbc6-bda27d465c35', 'attached_at': '', 'detached_at': '', 'volume_id': '01b6e07b-a45a-42a0-92d7-19f59724fca7', 'serial': '01b6e07b-a45a-42a0-92d7-19f59724fca7'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'numa_topology' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:33 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:33 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:33 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:33 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:33 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0698cb7b-ae80-4a65-8f07-3145aa87bb9b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XmhQHbDd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 00:38:33 user nova-compute[82394]: node.name = iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:38:33 user nova-compute[82394]: node.tpgt = -1
Apr 12 00:38:33 user nova-compute[82394]: node.startup = automatic
Apr 12 00:38:33 user nova-compute[82394]: node.leading_login = No
Apr 12 00:38:33 user nova-compute[82394]: iface.iscsi_ifacename = default
Apr 12 00:38:33 user nova-compute[82394]: iface.net_ifacename = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.ipaddress = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.prefix_len = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.hwaddress = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.transport_name = tcp
Apr 12 00:38:33 user nova-compute[82394]: iface.initiatorname = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.vlan_id = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.vlan_priority = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.vlan_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.iface_num = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.mtu = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.port = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.bootproto = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.subnet_mask = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.gateway = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_alt_client_id = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_dns = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_learn_iqn = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_vendor_id_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_vendor_id = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.dhcp_slp_da = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.fragmentation = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.gratuitous_arp = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.incoming_forwarding = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.tos_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.tos = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.ttl = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.delayed_ack = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.tcp_nagle = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.tcp_wsf_state = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.tcp_wsf = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.tcp_timer_scale = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.tcp_timestamp = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.redirect = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.def_task_mgmt_timeout = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.header_digest = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.data_digest = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.immediate_data = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.initial_r2t = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.data_seq_inorder = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.data_pdu_inorder = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.erl = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.max_receive_data_len = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.first_burst_len = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.max_outstanding_r2t = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.max_burst_len = 0
Apr 12 00:38:33 user nova-compute[82394]: iface.chap_auth = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.bidi_chap = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.strict_login_compliance = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.discovery_auth = <empty>
Apr 12 00:38:33 user nova-compute[82394]: iface.discovery_logout = <empty>
Apr 12 00:38:33 user nova-compute[82394]: node.discovery_address = <empty>
Apr 12 00:38:33 user nova-compute[82394]: node.discovery_port = 0
Apr 12 00:38:33 user nova-compute[82394]: node.discovery_type = static
Apr 12 00:38:33 user nova-compute[82394]: node.session.initial_cmdsn = 0
Apr 12 00:38:33 user nova-compute[82394]: node.session.initial_login_retry_max = 8
Apr 12 00:38:33 user nova-compute[82394]: node.session.xmit_thread_priority = -20
Apr 12 00:38:33 user nova-compute[82394]: node.session.cmds_max = 128
Apr 12 00:38:33 user nova-compute[82394]: node.session.queue_depth = 32
Apr 12 00:38:33 user nova-compute[82394]: node.session.nr_sessions = 1
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.authmethod = CHAP
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.username = XmhQHbDd
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.password = ***
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.username_in = <empty>
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.password_in = <empty>
Apr 12 00:38:33 user nova-compute[82394]: node.session.auth.chap_algs = MD5
Apr 12 00:38:33 user nova-compute[82394]: node.session.timeo.replacement_timeout = 120
Apr 12 00:38:33 user nova-compute[82394]: node.session.err_timeo.abort_timeout = 15
Apr 12 00:38:33 user nova-compute[82394]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 00:38:33 user nova-compute[82394]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 00:38:33 user nova-compute[82394]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.FastAbort = Yes
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.InitialR2T = No
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.ImmediateData = Yes
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.MaxConnections = 1
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 00:38:33 user nova-compute[82394]: node.session.iscsi.ERL = 0
Apr 12 00:38:33 user nova-compute[82394]: node.session.scan = manual
Apr 12 00:38:33 user nova-compute[82394]: node.session.reopen_max = 0
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].address = 172.16.0.220
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].port = 3260
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].startup = manual
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].tcp.window_size = 524288
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].tcp.type_of_service = 0
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].timeo.logout_timeout = 15
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].timeo.login_timeout = 15
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].timeo.auth_timeout = 45
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.DataDigest = None
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.IFMarker = No
Apr 12 00:38:33 user nova-compute[82394]: node.conn[0].iscsi.OFMarker = No
Apr 12 00:38:33 user nova-compute[82394]: # END RECORD
Apr 12 00:38:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eec7c5-f9de-4c7a-af5a-b9d615c0b452]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca204fb-7714-46ec-82f9-423e95586a86]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhQHbDd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhQHbDd" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b188bfca-bc0d-4e3c-a09b-9c2e150431ab]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmhQHbDd'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72515104-37ac-4b1b-b5fb-123bcc8b01db]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5cd87f-9f58-4fb9-8cbf-5fd181391f53]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:33 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:33 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:33 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76144f54-9227-4fc6-8768-76efbcc64985]: (4, ('0 0 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23438353433333065', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438353433333065', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-241003630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-241003630',id=23,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-usfiymz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:36:56Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=1277a40a-6389-4d88-bbc6-bda27d465c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:84:89:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:84:89:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:38:33 user nova-compute[82394]:   <uuid>1277a40a-6389-4d88-bbc6-bda27d465c35</uuid>
Apr 12 00:38:33 user nova-compute[82394]:   <name>instance-00000017</name>
Apr 12 00:38:33 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:38:33 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:38:33 user nova-compute[82394]:   <metadata>
Apr 12 00:38:33 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:38:33 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-241003630</nova:name>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:38:33</nova:creationTime>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:38:33 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:38:33 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:owner>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:38:33 user nova-compute[82394]:       </nova:owner>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:38:33 user nova-compute[82394]:       <nova:ports>
Apr 12 00:38:33 user nova-compute[82394]:         <nova:port uuid="8e32719d-1d2e-439a-9dba-9ac82140fbac">
Apr 12 00:38:33 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:38:33 user nova-compute[82394]:         </nova:port>
Apr 12 00:38:33 user nova-compute[82394]:       </nova:ports>
Apr 12 00:38:33 user nova-compute[82394]:     </nova:instance>
Apr 12 00:38:33 user nova-compute[82394]:   </metadata>
Apr 12 00:38:33 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:38:33 user nova-compute[82394]:     <system>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="serial">1277a40a-6389-4d88-bbc6-bda27d465c35</entry>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="uuid">1277a40a-6389-4d88-bbc6-bda27d465c35</entry>
Apr 12 00:38:33 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:38:33 user nova-compute[82394]:     </system>
Apr 12 00:38:33 user nova-compute[82394]:   </sysinfo>
Apr 12 00:38:33 user nova-compute[82394]:   <os>
Apr 12 00:38:33 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:38:33 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:38:33 user nova-compute[82394]:   </os>
Apr 12 00:38:33 user nova-compute[82394]:   <features>
Apr 12 00:38:33 user nova-compute[82394]:     <acpi/>
Apr 12 00:38:33 user nova-compute[82394]:     <apic/>
Apr 12 00:38:33 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:38:33 user nova-compute[82394]:   </features>
Apr 12 00:38:33 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:38:33 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:38:33 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:38:33 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:38:33 user nova-compute[82394]:   </clock>
Apr 12 00:38:33 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:38:33 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:38:33 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:38:33 user nova-compute[82394]:   </cpu>
Apr 12 00:38:33 user nova-compute[82394]:   <devices>
Apr 12 00:38:33 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:38:33 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:38:33 user nova-compute[82394]:       <source dev="/dev/sdc"/>
Apr 12 00:38:33 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:38:33 user nova-compute[82394]:       <serial>01b6e07b-a45a-42a0-92d7-19f59724fca7</serial>
Apr 12 00:38:33 user nova-compute[82394]:     </disk>
Apr 12 00:38:33 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:38:33 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:38:33 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue"/>
Apr 12 00:38:33 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:38:33 user nova-compute[82394]:       <boot order="1"/>
Apr 12 00:38:33 user nova-compute[82394]:     </disk>
Apr 12 00:38:33 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:38:33 user nova-compute[82394]:       <mac address="fa:16:3e:84:89:8e"/>
Apr 12 00:38:33 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:33 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:38:33 user nova-compute[82394]:       <target dev="tap8e32719d-1d"/>
Apr 12 00:38:33 user nova-compute[82394]:     </interface>
Apr 12 00:38:33 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:38:33 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/console.log" append="off"/>
Apr 12 00:38:33 user nova-compute[82394]:     </serial>
Apr 12 00:38:33 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:38:33 user nova-compute[82394]:     <video>
Apr 12 00:38:33 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:33 user nova-compute[82394]:     </video>
Apr 12 00:38:33 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:38:33 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:38:33 user nova-compute[82394]:     </rng>
Apr 12 00:38:33 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:38:33 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:38:33 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:38:33 user nova-compute[82394]:     </memballoon>
Apr 12 00:38:33 user nova-compute[82394]:   </devices>
Apr 12 00:38:33 user nova-compute[82394]: </domain>
Apr 12 00:38:33 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:38:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance destroyed successfully.
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:33 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:84:89:8e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:38:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:35 user nova-compute[82394]: WARNING nova.compute.manager [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state active and task_state rescuing.
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'flavor' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 1277a40a-6389-4d88-bbc6-bda27d465c35 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259917.4615982, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:37 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Resumed (Lifecycle Event)
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:37 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259917.4633927, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:37 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Started (Lifecycle Event)
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:37 user nova-compute[82394]: INFO nova.compute.manager [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attaching volume 09c62c76-e1a1-483c-a846-9f5be2dcec9b to /dev/vdb
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.utils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf78fef-383a-4bdd-a3d5-a71c1a892427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fae4f9-6469-44a3-9f0f-f95d7177291f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5147b4-82ba-427f-ba7b-bdad0b4b26a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79db396-b54a-4868-ad82-905b6b10e7db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:38:37 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c36592e-063b-438e-9a68-5ae3dfbc4ad9]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG os_brick.utils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating existing volume attachment record: 3907f675-ca6b-41c5-b5af-562b659e4231 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:37 user nova-compute[82394]: WARNING nova.compute.manager [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state rescued and task_state None.
Apr 12 00:38:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:41 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259906.572755, ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:41 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] VM Stopped (Lifecycle Event)
Apr 12 00:38:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-001e95b5-0c60-4aa1-a397-f98a8ba5b50e None None] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:42 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ca99c-4cd7-450b-8b8f-f4c509c1a531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:38:42 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638673b-c28e-4090-a210-ec165d74ad7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb798656-b2a1-4274-9846-5f5ed41b20e3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e162129-fa8b-4ef5-97af-aa62c8e2d155]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[712cc97c-42a2-4265-b9b1-cae12df07bc0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGdWqpOw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed74536-f02b-48d5-b432-5c1a7289a122]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4110f-9dc5-4806-ac08-865d195fe1d9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfb675-8dde-4f81-ad87-f25ff0438470]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:38:42 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7a059-254b-4e92-9f1e-a985ddd26584]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[347950bf-3a16-4dbb-bc7e-53c9eb5060b7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:42 user nova-compute[82394]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426eef9-206d-4c72-b9e5-fe811130201f]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:38:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259908.1439931, d8833bad-d30f-4cd4-aa66-10d60c782061 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:38:43 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] VM Stopped (Lifecycle Event)
Apr 12 00:38:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f5b45967-f097-48b5-8875-fca98eeaf871 None None] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG nova.objects.instance [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'flavor' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:38:43 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:38:43 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:38:43 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:38:43 user nova-compute[82394]:   <serial>09c62c76-e1a1-483c-a846-9f5be2dcec9b</serial>
Apr 12 00:38:43 user nova-compute[82394]: </disk>
Apr 12 00:38:43 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:38:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:a1:e7:04, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:38:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.768s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Stashing vm_state: active {{(pid=82394) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_requests' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:38:46 user nova-compute[82394]: INFO nova.compute.claims [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Claim successful on node user
Apr 12 00:38:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:46 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating resource usage from migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4
Apr 12 00:38:47 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.492s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:47 user nova-compute[82394]: INFO nova.compute.manager [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Migrating
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:47 user nova-compute[82394]: INFO nova.compute.rpcapi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Starting migrate_disk_and_power_off {{(pid=82394) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:48 user nova-compute[82394]: WARNING nova.compute.manager [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state resize_migrating.
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:48 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance destroyed successfully.
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG os_vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:38:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99b54c2-0b, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:49 user nova-compute[82394]: INFO os_vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:38:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:49 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f007b-1511-4366-88aa-c88279cce626]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:38:49 user nova-compute[82394]: No targets found.
Apr 12 00:38:49 user nova-compute[82394]: iSNS:
Apr 12 00:38:49 user nova-compute[82394]: No targets found.
Apr 12 00:38:49 user nova-compute[82394]: STATIC:
Apr 12 00:38:49 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:38:49 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:49 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:49 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:38:49 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:49 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:49 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:38:49 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:38:49 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:38:49 user nova-compute[82394]: FIRMWARE:
Apr 12 00:38:49 user nova-compute[82394]: No targets found.
Apr 12 00:38:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:38:49 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:38:49 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44fe5b-e851-46cf-907f-ce0c046cd4c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82fda8-ee54-47f3-a73c-560d49d57bd0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:49 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:49 user nova-compute[82394]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:49 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:49 user nova-compute[82394]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fef7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8810aad-eba4-43dd-af9b-174b4358f51a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ab3fb-246e-4816-abb1-0fb7eacd0520]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae841c9-7253-48cb-a3be-dedcebefc806]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc7e1e-cfd4-4c1f-88b6-3782faa0d1e6]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d7bc2d-44d4-4bba-8b59-4554e608d681]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[417db6bb-d108-4bb8-83ae-56832376915c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:38:49 user nova-compute[82394]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:38:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7bff94-7ffb-4716-ab77-3fc2122f786e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (319ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_resize/disk /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "cp -r /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_resize/disk /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk" returned: 0 in 0.276s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_resize/disk.info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "cp -r /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_resize/disk.info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk.info" returned: 0 in 0.031s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:50 user nova-compute[82394]: WARNING nova.compute.manager [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state resize_migrating.
Apr 12 00:38:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Port b99b54c2-0b21-42ea-91d0-087aa230da7e binding to destination host user is already ACTIVE {{(pid=82394) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.utils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7df559-e7a0-46b0-bacb-9250e090ff53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2c424-a596-4e00-beab-e563a20a7e5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[90026ccd-e68f-4678-a191-c820ebd5e25a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a887dbd-c7b0-40e4-be7d-009967f7fe6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:38:52 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756e405-8895-40c3-b06a-dcf9d78b323e]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG os_brick.utils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:55 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:55 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=26.30908203125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Applying migration context for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 as it has an incoming, in-progress migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4. Migration status is post-migrating {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 00:38:56 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating resource usage from migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance daa798af-8437-4083-b73c-92b0cb39d861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance f2164441-0fa4-463c-afde-a333095d0e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Starting finish_migration {{(pid=82394) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:38:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating image(s)
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Cannot resize image /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Ensure instance console log exists: /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start _get_guest_xml network_info=[{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31da3546-927e-419e-9153-b98dcc43590d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14', 'attached_at': '2023-04-12T00:38:56.000000', 'detached_at': '', 'volume_id': '09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'serial': '09c62c76-e1a1-483c-a846-9f5be2dcec9b'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:38:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:56 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:38:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:38:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:38:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:38:57 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace21b5a-6f93-418f-95af-2fbd50674316]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:38:57 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[593acba5-7bf5-41b5-ab6b-d417fbd0a517]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28d57e7-31bb-4c4d-98ee-e7e818616f59]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0410c4e5-5f5c-4204-974b-e2036e4694dc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7c88d-f899-47d8-9ba0-a6d0a58075fe]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGdWqpOw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74deb0-7819-4579-a593-3d97cd2fdf95]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c13e8e-081f-4b6e-a83b-f4d66e5dd188]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd199a5-8f16-483b-938f-8b396cbd2656]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:38:57 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b699cb43-b3cf-4e38-b75a-1aaab7364105]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd98e5-27da-4925-b49f-435906b910f3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:38:57 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:38:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e078620-1a4f-49ce-89e4-a0309480b615]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:38:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:38:58 user nova-compute[82394]:   <uuid>dbe6d6bc-65a6-469a-89a0-7e4c51620b14</uuid>
Apr 12 00:38:58 user nova-compute[82394]:   <name>instance-00000004</name>
Apr 12 00:38:58 user nova-compute[82394]:   <memory>196608</memory>
Apr 12 00:38:58 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:38:58 user nova-compute[82394]:   <metadata>
Apr 12 00:38:58 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:38:58 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-197146176</nova:name>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:38:56</nova:creationTime>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:flavor name="m1.micro">
Apr 12 00:38:58 user nova-compute[82394]:         <nova:memory>192</nova:memory>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:38:58 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:owner>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:38:58 user nova-compute[82394]:       </nova:owner>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:38:58 user nova-compute[82394]:       <nova:ports>
Apr 12 00:38:58 user nova-compute[82394]:         <nova:port uuid="b99b54c2-0b21-42ea-91d0-087aa230da7e">
Apr 12 00:38:58 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:38:58 user nova-compute[82394]:         </nova:port>
Apr 12 00:38:58 user nova-compute[82394]:       </nova:ports>
Apr 12 00:38:58 user nova-compute[82394]:     </nova:instance>
Apr 12 00:38:58 user nova-compute[82394]:   </metadata>
Apr 12 00:38:58 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:38:58 user nova-compute[82394]:     <system>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="serial">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="uuid">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:38:58 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:38:58 user nova-compute[82394]:     </system>
Apr 12 00:38:58 user nova-compute[82394]:   </sysinfo>
Apr 12 00:38:58 user nova-compute[82394]:   <os>
Apr 12 00:38:58 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:38:58 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:38:58 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:38:58 user nova-compute[82394]:   </os>
Apr 12 00:38:58 user nova-compute[82394]:   <features>
Apr 12 00:38:58 user nova-compute[82394]:     <acpi/>
Apr 12 00:38:58 user nova-compute[82394]:     <apic/>
Apr 12 00:38:58 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:38:58 user nova-compute[82394]:   </features>
Apr 12 00:38:58 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:38:58 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:38:58 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:38:58 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:38:58 user nova-compute[82394]:   </clock>
Apr 12 00:38:58 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:38:58 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:38:58 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:38:58 user nova-compute[82394]:   </cpu>
Apr 12 00:38:58 user nova-compute[82394]:   <devices>
Apr 12 00:38:58 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:38:58 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:38:58 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk"/>
Apr 12 00:38:58 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:38:58 user nova-compute[82394]:     </disk>
Apr 12 00:38:58 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:38:58 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:38:58 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:38:58 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:38:58 user nova-compute[82394]:       <serial>09c62c76-e1a1-483c-a846-9f5be2dcec9b</serial>
Apr 12 00:38:58 user nova-compute[82394]:     </disk>
Apr 12 00:38:58 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:38:58 user nova-compute[82394]:       <mac address="fa:16:3e:a1:e7:04"/>
Apr 12 00:38:58 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:58 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:38:58 user nova-compute[82394]:       <target dev="tapb99b54c2-0b"/>
Apr 12 00:38:58 user nova-compute[82394]:     </interface>
Apr 12 00:38:58 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:38:58 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log" append="off"/>
Apr 12 00:38:58 user nova-compute[82394]:     </serial>
Apr 12 00:38:58 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:38:58 user nova-compute[82394]:     <video>
Apr 12 00:38:58 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:38:58 user nova-compute[82394]:     </video>
Apr 12 00:38:58 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:38:58 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:38:58 user nova-compute[82394]:     </rng>
Apr 12 00:38:58 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:38:58 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:38:58 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:38:58 user nova-compute[82394]:     </memballoon>
Apr 12 00:38:58 user nova-compute[82394]:   </devices>
Apr 12 00:38:58 user nova-compute[82394]: </domain>
Apr 12 00:38:58 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:a1:e7:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG os_vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99b54c2-0b, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb99b54c2-0b, col_values=(('external_ids', {'iface-id': 'b99b54c2-0b21-42ea-91d0-087aa230da7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e7:04', 'vm-uuid': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:58 user nova-compute[82394]: INFO os_vif [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:38:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:a1:e7:04, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:59 user nova-compute[82394]: INFO nova.compute.manager [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Detaching volume 04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:38:59 user nova-compute[82394]: INFO nova.virt.block_device [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Attempting to driver detach volume 04e2cfac-63fa-480c-a8bd-f583809971ab from mountpoint /dev/vdb
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Attempting to detach device vdb from instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:38:59 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:38:59 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:38:59 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:38:59 user nova-compute[82394]:   <serial>04e2cfac-63fa-480c-a8bd-f583809971ab</serial>
Apr 12 00:38:59 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:38:59 user nova-compute[82394]: </disk>
Apr 12 00:38:59 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:38:59 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a from the persistent domain config.
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:38:59 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:38:59 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:38:59 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:38:59 user nova-compute[82394]:   <serial>04e2cfac-63fa-480c-a8bd-f583809971ab</serial>
Apr 12 00:38:59 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:38:59 user nova-compute[82394]: </disk>
Apr 12 00:38:59 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:38:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:38:59 user nova-compute[82394]: WARNING nova.compute.manager [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state resize_finish.
Apr 12 00:39:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681259940.3480368, 2bae2f38-fd5e-4d51-be63-22bbf54cd77a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:39:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a from the live domain config.
Apr 12 00:39:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFawTbdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:39:00 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8aaa2d-0de9-4b80-9f81-f668d333c409]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:39:00 user nova-compute[82394]: No targets found.
Apr 12 00:39:00 user nova-compute[82394]: iSNS:
Apr 12 00:39:00 user nova-compute[82394]: No targets found.
Apr 12 00:39:00 user nova-compute[82394]: STATIC:
Apr 12 00:39:00 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:39:00 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:39:00 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:39:00 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab
Apr 12 00:39:00 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:39:00 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:39:00 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:39:00 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:39:00 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:39:00 user nova-compute[82394]: FIRMWARE:
Apr 12 00:39:00 user nova-compute[82394]: No targets found.
Apr 12 00:39:00 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:39:00 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:39:00 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[59767497-e704-4198-92d6-df4a4d3c2d0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d8a317-894b-4884-b036-6f96651d7b26]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:39:00 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:00 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:00 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab (non-flash)
Apr 12 00:39:00 user nova-compute[82394]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:00 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:00 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fab010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab'): ({'sdf'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Removing single pathed devices sdf {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d7079-29bf-4ec7-a77d-901b9e9953ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[83807125-b50f-4830-88c0-5da899460068]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flushing IO for device /dev/sdf {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[164fb8e5-065e-4355-9998-5f3435511c32]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[188b64c4-7ea9-4f36-92c0-96c6b9c0467e]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c50817-ffcd-49fc-b058-e3f95c53d6eb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0edb6-1055-40d2-9712-481a28413f1f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260]
Apr 12 00:39:00 user nova-compute[82394]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab, portal: 172.16.0.220,3260] successful.
Apr 12 00:39:00 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e2cfac-63fa-480c-a8bd-f583809971ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62362fae-04b0-4313-aa46-c0a8bd98b949]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== disconnect_volume: return (312ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:39:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:39:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:39:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.091s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:02 user nova-compute[82394]: WARNING nova.compute.manager [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state resize_finish.
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for dbe6d6bc-65a6-469a-89a0-7e4c51620b14 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259942.2610788, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:39:02 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Resumed (Lifecycle Event)
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:39:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance running successfully.
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Failed to set time: agent not configured {{(pid=82394) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] finish_migration finished successfully. {{(pid=82394) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:39:02 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259942.263263, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:39:02 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Started (Lifecycle Event)
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:39:02 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 00:39:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:39:24 user nova-compute[82394]: INFO nova.compute.claims [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Claim successful on node user
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:24 user nova-compute[82394]: INFO nova.compute.manager [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Terminating instance
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:39:24 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Instance destroyed successfully.
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lazy-loading 'resources' on Instance uuid daa798af-8437-4083-b73c-92b0cb39d861 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-752173567',display_name='tempest-VolumesNegativeTest-instance-752173567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-752173567',id=24,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d6cebaed9654692bd9aef950a08741b',ramdisk_id='',reservation_id='r-70p2oftm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-791919853',owner_user_name='tempest-VolumesNegativeTest-791919853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:37:42Z,user_data=None,user_id='7724cf4de81c4147929f43fd8744e8f9',uuid=daa798af-8437-4083-b73c-92b0cb39d861,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converting VIF {"id": "204e9845-040e-4b8d-a957-b70dd44b340b", "address": "fa:16:3e:56:fe:df", "network": {"id": "78a07480-6ca7-41a7-83af-5aff3adc3912", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "013156ef7e1849449f7481670a064c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204e9845-04", "ovs_interfaceid": "204e9845-040e-4b8d-a957-b70dd44b340b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_vif [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap204e9845-04, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: INFO os_vif [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:df,bridge_name='br-int',has_traffic_filtering=True,id=204e9845-040e-4b8d-a957-b70dd44b340b,network=Network(78a07480-6ca7-41a7-83af-5aff3adc3912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204e9845-04')
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Deleting instance files /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861_del
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Deletion of /opt/stack/data/nova/instances/daa798af-8437-4083-b73c-92b0cb39d861_del complete
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.virt.block_device [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Booting with volume 39255a99-7938-4a08-af09-fe2d718c4fda at /dev/vda
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.policy [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:39:25 user nova-compute[82394]: INFO nova.compute.manager [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[847255d2-bd35-4e9b-b5ca-9875ff827eab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f2658-a24a-4c57-b652-807b15c00b35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0779ad-c7ce-470c-af53-11bde33d81f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd47f54-2f6f-4d64-9c93-e5bdae5bbe48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:39:25 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:39:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdb1ba-4f58-44f3-99fa-729aa1cd03f1]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (287ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:39:25 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updating existing volume attachment record: 7d211f38-b2d4-4e38-8b3e-d8d74bbb2264 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:26 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Took 1.31 seconds to deallocate network for instance.
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-deleted-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Successfully created port: d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:26 user nova-compute[82394]: WARNING nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state deleted and task_state None.
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:26 user nova-compute[82394]: WARNING nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state deleted and task_state None.
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:26 user nova-compute[82394]: WARNING nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state deleted and task_state None.
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:26 user nova-compute[82394]: WARNING nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-unplugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state deleted and task_state None.
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "daa798af-8437-4083-b73c-92b0cb39d861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "daa798af-8437-4083-b73c-92b0cb39d861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] No waiting events found dispatching network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:26 user nova-compute[82394]: WARNING nova.compute.manager [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Received unexpected event network-vif-plugged-204e9845-040e-4b8d-a957-b70dd44b340b for instance with vm_state deleted and task_state None.
Apr 12 00:39:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:27 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Deleted allocations for instance daa798af-8437-4083-b73c-92b0cb39d861
Apr 12 00:39:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "daa798af-8437-4083-b73c-92b0cb39d861" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Successfully updated port: d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:39:27 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-changed-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG nova.compute.manager [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Refreshing instance network info cache due to event network-changed-d71af90a-89b8-414c-9bac-b2a9605aeec5. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Acquiring lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updating instance_info_cache with network_info: [{"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Instance network_info: |[{"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Acquired lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:39:28 user nova-compute[82394]: DEBUG nova.network.neutron [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Refreshing network info cache for port d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:39:29 user nova-compute[82394]: DEBUG nova.network.neutron [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updated VIF entry in instance network info cache for port d71af90a-89b8-414c-9bac-b2a9605aeec5. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:39:29 user nova-compute[82394]: DEBUG nova.network.neutron [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updating instance_info_cache with network_info: [{"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Releasing lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:39:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Creating image(s)
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Ensure instance console log exists: /opt/stack/data/nova/instances/ecfc9ba1-d560-410d-af55-8d5e578aa00d/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Start _get_guest_xml network_info=[{"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7d211f38-b2d4-4e38-8b3e-d8d74bbb2264', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ecfc9ba1-d560-410d-af55-8d5e578aa00d', 'attached_at': '', 'detached_at': '', 'volume_id': '39255a99-7938-4a08-af09-fe2d718c4fda', 'serial': '39255a99-7938-4a08-af09-fe2d718c4fda'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:39:30 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:39:30 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:39:30 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:39:30 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:39:30 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeecfd7-0edd-4620-86a1-5bd0e0905a3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:39:30 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0e129-bbae-48da-a69c-3e1934247446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda] added
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6738b-34bd-4d66-ab29-5b08060decd1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ed5271-2393-4a6d-ad59-c51adac66349]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVRDsQTE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVRDsQTE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[528083da-d072-4d0d-ad4d-0f43ea68d77c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVRDsQTE'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e23967-6c00-4227-b0c5-7404856b23fd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273f3db-c3d0-4088-b9a5-e610c0f1001a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acea426-da95-4ae6-b5c8-eee52018715b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]
Apr 12 00:39:30 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4bbdac-499e-4a6e-a778-48cbb2957f27]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[181986db-b06c-4b91-894d-a73c2dd6f183]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:39:30 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:39:30 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb105a-c6e9-4424-bd67-547964bc9aa9]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:39:30 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23633653462336332', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633653462336332', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1445873100',display_name='tempest-TestVolumeBootPattern-server-1445873100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1445873100',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-07x9n30r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:39:25Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ecfc9ba1-d560-410d-af55-8d5e578aa00d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid ecfc9ba1-d560-410d-af55-8d5e578aa00d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:39:31 user nova-compute[82394]:   <uuid>ecfc9ba1-d560-410d-af55-8d5e578aa00d</uuid>
Apr 12 00:39:31 user nova-compute[82394]:   <name>instance-0000001b</name>
Apr 12 00:39:31 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:39:31 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:39:31 user nova-compute[82394]:   <metadata>
Apr 12 00:39:31 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:39:31 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:39:31 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-server-1445873100</nova:name>
Apr 12 00:39:31 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:39:30</nova:creationTime>
Apr 12 00:39:31 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:39:31 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:39:31 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:39:31 user nova-compute[82394]:       <nova:owner>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:39:31 user nova-compute[82394]:       </nova:owner>
Apr 12 00:39:31 user nova-compute[82394]:       <nova:ports>
Apr 12 00:39:31 user nova-compute[82394]:         <nova:port uuid="d71af90a-89b8-414c-9bac-b2a9605aeec5">
Apr 12 00:39:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 00:39:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:39:31 user nova-compute[82394]:       </nova:ports>
Apr 12 00:39:31 user nova-compute[82394]:     </nova:instance>
Apr 12 00:39:31 user nova-compute[82394]:   </metadata>
Apr 12 00:39:31 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:39:31 user nova-compute[82394]:     <system>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="serial">ecfc9ba1-d560-410d-af55-8d5e578aa00d</entry>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="uuid">ecfc9ba1-d560-410d-af55-8d5e578aa00d</entry>
Apr 12 00:39:31 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:39:31 user nova-compute[82394]:     </system>
Apr 12 00:39:31 user nova-compute[82394]:   </sysinfo>
Apr 12 00:39:31 user nova-compute[82394]:   <os>
Apr 12 00:39:31 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:39:31 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:39:31 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:39:31 user nova-compute[82394]:   </os>
Apr 12 00:39:31 user nova-compute[82394]:   <features>
Apr 12 00:39:31 user nova-compute[82394]:     <acpi/>
Apr 12 00:39:31 user nova-compute[82394]:     <apic/>
Apr 12 00:39:31 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:39:31 user nova-compute[82394]:   </features>
Apr 12 00:39:31 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:39:31 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:39:31 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:39:31 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:39:31 user nova-compute[82394]:   </clock>
Apr 12 00:39:31 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:39:31 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:39:31 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:39:31 user nova-compute[82394]:   </cpu>
Apr 12 00:39:31 user nova-compute[82394]:   <devices>
Apr 12 00:39:31 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:39:31 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:39:31 user nova-compute[82394]:       <source dev="/dev/sdd"/>
Apr 12 00:39:31 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:39:31 user nova-compute[82394]:       <serial>39255a99-7938-4a08-af09-fe2d718c4fda</serial>
Apr 12 00:39:31 user nova-compute[82394]:     </disk>
Apr 12 00:39:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:39:31 user nova-compute[82394]:       <mac address="fa:16:3e:42:41:96"/>
Apr 12 00:39:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:39:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:39:31 user nova-compute[82394]:       <target dev="tapd71af90a-89"/>
Apr 12 00:39:31 user nova-compute[82394]:     </interface>
Apr 12 00:39:31 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:39:31 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/ecfc9ba1-d560-410d-af55-8d5e578aa00d/console.log" append="off"/>
Apr 12 00:39:31 user nova-compute[82394]:     </serial>
Apr 12 00:39:31 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:39:31 user nova-compute[82394]:     <video>
Apr 12 00:39:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:39:31 user nova-compute[82394]:     </video>
Apr 12 00:39:31 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:39:31 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:39:31 user nova-compute[82394]:     </rng>
Apr 12 00:39:31 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:39:31 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:39:31 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:39:31 user nova-compute[82394]:     </memballoon>
Apr 12 00:39:31 user nova-compute[82394]:   </devices>
Apr 12 00:39:31 user nova-compute[82394]: </domain>
Apr 12 00:39:31 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1445873100',display_name='tempest-TestVolumeBootPattern-server-1445873100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1445873100',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-07x9n30r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:39:25Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ecfc9ba1-d560-410d-af55-8d5e578aa00d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG os_vif [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd71af90a-89, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd71af90a-89, col_values=(('external_ids', {'iface-id': 'd71af90a-89b8-414c-9bac-b2a9605aeec5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:41:96', 'vm-uuid': 'ecfc9ba1-d560-410d-af55-8d5e578aa00d'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:39:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:31 user nova-compute[82394]: INFO os_vif [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89')
Apr 12 00:39:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:39:32 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:42:41:96, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] No waiting events found dispatching network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:33 user nova-compute[82394]: WARNING nova.compute.manager [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received unexpected event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance with vm_state building and task_state spawning.
Apr 12 00:39:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259975.494546, ecfc9ba1-d560-410d-af55-8d5e578aa00d => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] VM Resumed (Lifecycle Event)
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Instance spawned successfully.
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681259975.4958794, ecfc9ba1-d560-410d-af55-8d5e578aa00d => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] VM Started (Lifecycle Event)
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] No waiting events found dispatching network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:35 user nova-compute[82394]: WARNING nova.compute.manager [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received unexpected event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance with vm_state building and task_state spawning.
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Took 5.12 seconds to spawn the instance on the hypervisor.
Apr 12 00:39:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:35 user nova-compute[82394]: INFO nova.compute.manager [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Took 11.31 seconds to build instance.
Apr 12 00:39:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.416s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:40 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259965.2066, daa798af-8437-4083-b73c-92b0cb39d861 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:39:40 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: daa798af-8437-4083-b73c-92b0cb39d861] VM Stopped (Lifecycle Event)
Apr 12 00:39:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-577687f1-adef-48af-9b26-0dc01502e616 None None] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:39:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:46 user nova-compute[82394]: INFO nova.compute.manager [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Terminating instance
Apr 12 00:39:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-unplugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] No waiting events found dispatching network-vif-unplugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-unplugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:39:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Instance destroyed successfully.
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'resources' on Instance uuid f2164441-0fa4-463c-afde-a333095d0e56 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980059856',display_name='tempest-VolumesAdminNegativeTest-server-980059856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980059856',id=25,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:38:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-ndv0mwq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:38:00Z,user_data=None,user_id='c276268b63084515a43caa837af30fb1',uuid=f2164441-0fa4-463c-afde-a333095d0e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "address": "fa:16:3e:97:32:f3", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b36ad5a-35", "ovs_interfaceid": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG os_vif [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b36ad5a-35, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:39:47 user nova-compute[82394]: INFO os_vif [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:f3,bridge_name='br-int',has_traffic_filtering=True,id=6b36ad5a-353d-438b-95d1-fddbcfe01e2c,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b36ad5a-35')
Apr 12 00:39:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Deleting instance files /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56_del
Apr 12 00:39:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Deletion of /opt/stack/data/nova/instances/f2164441-0fa4-463c-afde-a333095d0e56_del complete
Apr 12 00:39:47 user nova-compute[82394]: INFO nova.compute.manager [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 12 00:39:47 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:47 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Took 0.58 seconds to deallocate network for instance.
Apr 12 00:39:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-deleted-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:48 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Deleted allocations for instance f2164441-0fa4-463c-afde-a333095d0e56
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "f2164441-0fa4-463c-afde-a333095d0e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:39:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Acquiring lock "f2164441-0fa4-463c-afde-a333095d0e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Lock "f2164441-0fa4-463c-afde-a333095d0e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] No waiting events found dispatching network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:49 user nova-compute[82394]: WARNING nova.compute.manager [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Received unexpected event network-vif-plugged-6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance with vm_state deleted and task_state None.
Apr 12 00:39:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:50 user nova-compute[82394]: INFO nova.compute.manager [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Terminating instance
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-unplugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] No waiting events found dispatching network-vif-unplugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-unplugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Instance destroyed successfully.
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'resources' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467071576',display_name='tempest-AttachVolumeNegativeTest-server-1467071576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467071576',id=18,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIysUobFmc9X5YdnMYwlIEcSJnigDvHGxIpk+TP1afUFzLWmVglTO+snpoAKu69KheIwgjwoZA4vqNtG3U+76qhSJXgwg/N8/c0zXljFc8EJZe2wiop3pLQC7bMyegVYkg==',key_name='tempest-keypair-1703783656',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-g9yjwtn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=2bae2f38-fd5e-4d51-be63-22bbf54cd77a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "address": "fa:16:3e:4e:19:52", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa152413c-fa", "ovs_interfaceid": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG os_vif [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa152413c-fa, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:39:50 user nova-compute[82394]: INFO os_vif [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:19:52,bridge_name='br-int',has_traffic_filtering=True,id=a152413c-fa33-4f4e-8c91-2b8a8c5565b6,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa152413c-fa')
Apr 12 00:39:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Deleting instance files /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a_del
Apr 12 00:39:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Deletion of /opt/stack/data/nova/instances/2bae2f38-fd5e-4d51-be63-22bbf54cd77a_del complete
Apr 12 00:39:50 user nova-compute[82394]: INFO nova.compute.manager [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 00:39:50 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:39:50 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:39:51 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:51 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Took 0.98 seconds to deallocate network for instance.
Apr 12 00:39:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-deleted-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Acquiring lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] No waiting events found dispatching network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:39:52 user nova-compute[82394]: WARNING nova.compute.manager [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Received unexpected event network-vif-plugged-a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance with vm_state deleted and task_state None.
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:52 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Deleted allocations for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "2bae2f38-fd5e-4d51-be63-22bbf54cd77a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:39:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:39:55 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:39:55 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=26.3526611328125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Applying migration context for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 as it has an incoming, in-progress migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4. Migration status is finished {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 00:39:55 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating resource usage from migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:39:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:39:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:39:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:39:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:39:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:40:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:02 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259987.3029807, f2164441-0fa4-463c-afde-a333095d0e56 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:02 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: f2164441-0fa4-463c-afde-a333095d0e56] VM Stopped (Lifecycle Event)
Apr 12 00:40:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-0b45daa5-59e3-48d1-9741-43befe132695 None None] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:05 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681259990.813788, 2bae2f38-fd5e-4d51-be63-22bbf54cd77a => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:05 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] VM Stopped (Lifecycle Event)
Apr 12 00:40:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d843a993-4d69-4fda-8a9c-fa61b333db15 None None] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing instance network info cache due to event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.objects.instance [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:10 user nova-compute[82394]: INFO nova.compute.manager [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Attaching volume 41a82ec2-4e13-4a4b-980f-66064c4ec035 to /dev/vdb
Apr 12 00:40:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.utils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5964017a-7e51-49b4-9e55-adbc655bb7ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[80723934-2df6-4618-ad68-82f31d71e8bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[141c3db1-fbe4-4387-aa8b-cbad48791c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4575e3-763a-4713-8e5c-736c9b1d8881]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:40:10 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a758bc-9a29-4d82-aeb3-7fa2e71012ac]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG os_brick.utils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating existing volume attachment record: 4086b472-b3af-46f8-82c3-ea5fefa25df0 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updated VIF entry in instance network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWqQYTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:40:14 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:40:14 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:40:14 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24b1f8-1f41-4ca0-8418-5810123c5c10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:40:14 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca153257-37e9-4502-a243-e58ec96fe1b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035] added
Apr 12 00:40:14 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[60114383-bd13-48fb-97d5-d08a372f5aa3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dd6914-76e4-4205-a07d-f7744c2e3ffd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWqQYTs {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWqQYTs" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b237c5bf-b3bd-47f2-9fc6-d63262f5e396]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjWqQYTs'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6ea63-67b2-4920-824b-21b1a9f7a250]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273c778-d895-4229-9514-3c20efd22dc0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92bf5d4-8033-4ff8-81c5-2c999c2409cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260]
Apr 12 00:40:15 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260] successful.
Apr 12 00:40:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[32313662-958d-4ff1-9651-9c193079e231]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf7c415-8d38-44f3-9997-5fef1eb75313]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:15 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:15 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[909a79d5-4d2e-4cbf-a27b-c8e9db02e2ce]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWqQYTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23931343530363064', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931343530363064', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:40:16 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:40:16 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:40:16 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:40:16 user nova-compute[82394]:   <serial>41a82ec2-4e13-4a4b-980f-66064c4ec035</serial>
Apr 12 00:40:16 user nova-compute[82394]: </disk>
Apr 12 00:40:16 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:ce:56:00, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:40:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.505s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:18 user nova-compute[82394]: INFO nova.compute.manager [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Rescuing
Apr 12 00:40:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:19 user nova-compute[82394]: WARNING nova.compute.manager [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state active and task_state rescuing.
Apr 12 00:40:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance destroyed successfully.
Apr 12 00:40:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Attempting rescue
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:40:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Creating image(s)
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'trusted_certs' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.127s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue" returned: 0 in 0.051s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'migration_context' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start _get_guest_xml network_info=[{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ce:56:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'numa_topology' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1581384647',display_name='tempest-ServerRescueNegativeTestJSON-server-1581384647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1581384647',id=26,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcEUBZp/r0Qr+iXZ7VL0L/sg/DlCeGc9XiO7Mbog1Rn8MLmZsv660DZ2ywYiThGWPYBU7SmwQ5EYhiLYCMFIdiItGknXyBfY++d6oZR6/JM9QXgkOzqORWBqeFGCztcw==',key_name='tempest-keypair-936664235',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:38:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-b6l1ni5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b9421443b2f421298a934122c6a8b8c',uuid=49c8e8b7-1f91-4cf5-a222-c787a186444d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ce:56:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "vif_mac": "fa:16:3e:ce:56:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:40:19 user nova-compute[82394]:   <uuid>49c8e8b7-1f91-4cf5-a222-c787a186444d</uuid>
Apr 12 00:40:19 user nova-compute[82394]:   <name>instance-0000001a</name>
Apr 12 00:40:19 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:40:19 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:40:19 user nova-compute[82394]:   <metadata>
Apr 12 00:40:19 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:40:19 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1581384647</nova:name>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:40:19</nova:creationTime>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:40:19 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:40:19 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:owner>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:user uuid="6b9421443b2f421298a934122c6a8b8c">tempest-ServerRescueNegativeTestJSON-1300870234-project-member</nova:user>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:project uuid="fcf1fea74ef143e6b394e41e7c4ed495">tempest-ServerRescueNegativeTestJSON-1300870234</nova:project>
Apr 12 00:40:19 user nova-compute[82394]:       </nova:owner>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:40:19 user nova-compute[82394]:       <nova:ports>
Apr 12 00:40:19 user nova-compute[82394]:         <nova:port uuid="a2a25522-be49-4ac7-9893-d030dc2d87ab">
Apr 12 00:40:19 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:40:19 user nova-compute[82394]:         </nova:port>
Apr 12 00:40:19 user nova-compute[82394]:       </nova:ports>
Apr 12 00:40:19 user nova-compute[82394]:     </nova:instance>
Apr 12 00:40:19 user nova-compute[82394]:   </metadata>
Apr 12 00:40:19 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:40:19 user nova-compute[82394]:     <system>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="serial">49c8e8b7-1f91-4cf5-a222-c787a186444d</entry>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="uuid">49c8e8b7-1f91-4cf5-a222-c787a186444d</entry>
Apr 12 00:40:19 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:40:19 user nova-compute[82394]:     </system>
Apr 12 00:40:19 user nova-compute[82394]:   </sysinfo>
Apr 12 00:40:19 user nova-compute[82394]:   <os>
Apr 12 00:40:19 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:40:19 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:40:19 user nova-compute[82394]:   </os>
Apr 12 00:40:19 user nova-compute[82394]:   <features>
Apr 12 00:40:19 user nova-compute[82394]:     <acpi/>
Apr 12 00:40:19 user nova-compute[82394]:     <apic/>
Apr 12 00:40:19 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:40:19 user nova-compute[82394]:   </features>
Apr 12 00:40:19 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:40:19 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:40:19 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:40:19 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:40:19 user nova-compute[82394]:   </clock>
Apr 12 00:40:19 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:40:19 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:40:19 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:40:19 user nova-compute[82394]:   </cpu>
Apr 12 00:40:19 user nova-compute[82394]:   <devices>
Apr 12 00:40:19 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:40:19 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:40:19 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue"/>
Apr 12 00:40:19 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:40:19 user nova-compute[82394]:     </disk>
Apr 12 00:40:19 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:40:19 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:40:19 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk"/>
Apr 12 00:40:19 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:40:19 user nova-compute[82394]:     </disk>
Apr 12 00:40:19 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:40:19 user nova-compute[82394]:       <mac address="fa:16:3e:ce:56:00"/>
Apr 12 00:40:19 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:19 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:40:19 user nova-compute[82394]:       <target dev="tapa2a25522-be"/>
Apr 12 00:40:19 user nova-compute[82394]:     </interface>
Apr 12 00:40:19 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:40:19 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/console.log" append="off"/>
Apr 12 00:40:19 user nova-compute[82394]:     </serial>
Apr 12 00:40:19 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:40:19 user nova-compute[82394]:     <video>
Apr 12 00:40:19 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:19 user nova-compute[82394]:     </video>
Apr 12 00:40:19 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:40:19 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:40:19 user nova-compute[82394]:     </rng>
Apr 12 00:40:19 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:40:19 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:40:19 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:40:19 user nova-compute[82394]:     </memballoon>
Apr 12 00:40:19 user nova-compute[82394]:   </devices>
Apr 12 00:40:19 user nova-compute[82394]: </domain>
Apr 12 00:40:19 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:40:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance destroyed successfully.
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] No VIF found with MAC fa:16:3e:ce:56:00, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:40:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:21 user nova-compute[82394]: WARNING nova.compute.manager [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state active and task_state rescuing.
Apr 12 00:40:21 user nova-compute[82394]: INFO nova.compute.manager [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Unrescuing
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'flavor' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:22 user nova-compute[82394]: WARNING nova.compute.manager [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:40:22 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance destroyed successfully.
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:23 user nova-compute[82394]: WARNING nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state active and task_state rescuing.
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:23 user nova-compute[82394]: WARNING nova.compute.manager [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state active and task_state rescuing.
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 49c8e8b7-1f91-4cf5-a222-c787a186444d due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260023.7618542, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:23 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Resumed (Lifecycle Event)
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:23 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260023.7620473, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:23 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Started (Lifecycle Event)
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:23 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:24 user nova-compute[82394]: WARNING nova.compute.manager [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:40:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 1277a40a-6389-4d88-bbc6-bda27d465c35 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260026.5370855, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Resumed (Lifecycle Event)
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260026.5389802, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:26 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Started (Lifecycle Event)
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:26 user nova-compute[82394]: WARNING nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state active and task_state None.
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:26 user nova-compute[82394]: WARNING nova.compute.manager [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state active and task_state None.
Apr 12 00:40:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:36 user nova-compute[82394]: DEBUG nova.network.neutron [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Port b99b54c2-0b21-42ea-91d0-087aa230da7e binding to destination host user is already ACTIVE {{(pid=82394) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 00:40:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:36 user nova-compute[82394]: DEBUG nova.network.neutron [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.network.neutron [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Creating tmpfile /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/tmpapei8id4 to verify with other compute node that the instance is on the same shared storage. {{(pid=82394) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:37 user nova-compute[82394]: WARNING nova.compute.manager [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state resized and task_state resize_reverting.
Apr 12 00:40:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance destroyed successfully.
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG os_vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99b54c2-0b, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:40:37 user nova-compute[82394]: INFO os_vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:40:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:40:37 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:40:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:40:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ea89f6-9c8c-4ba3-bb97-4111729eb864]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:40:38 user nova-compute[82394]: No targets found.
Apr 12 00:40:38 user nova-compute[82394]: iSNS:
Apr 12 00:40:38 user nova-compute[82394]: No targets found.
Apr 12 00:40:38 user nova-compute[82394]: STATIC:
Apr 12 00:40:38 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:40:38 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:40:38 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:40:38 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:40:38 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:40:38 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:40:38 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:40:38 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:40:38 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:40:38 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:40:38 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:40:38 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:40:38 user nova-compute[82394]: FIRMWARE:
Apr 12 00:40:38 user nova-compute[82394]: No targets found.
Apr 12 00:40:38 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:40:38 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:40:38 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[41facf7a-5bf4-4cf8-b5f6-c49b2bf8ab76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30cc408-a185-4c0b-8bf2-ec8b96fa0204]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:38 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:38 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:38 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fbc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f23dfbe-d0e8-424e-a7ff-5e4ba097a57e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f2f19-145c-4257-a3f0-9ee9fd075dd3]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09435bc-308a-4831-9df6-a64869cc4fc7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ba253-d4a8-465a-8fa8-7fd223cd3858]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b52583-76b1-47c4-8f51-2d8f3e41c0db]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2e11e-d3a2-4acb-a731-12842fbc854a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:40:38 user nova-compute[82394]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:40:38 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4147eed8-1198-4fb0-b704-1bbb191f9033]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (314ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:40:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.objects.instance [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'migration_context' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:39 user nova-compute[82394]: WARNING nova.compute.manager [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state resized and task_state resize_reverting.
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:39 user nova-compute[82394]: INFO nova.compute.manager [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Terminating instance
Apr 12 00:40:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.373s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:39 user nova-compute[82394]: INFO nova.compute.manager [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Swapping old allocation on dict_keys(['d7e79abf-0487-4aad-a897-f0694d34c558']) held by migration 96414bce-6ef8-4a9d-b04d-ef03bbbe00c4 for instance
Apr 12 00:40:39 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Overwriting current allocation {'allocations': {'d7e79abf-0487-4aad-a897-f0694d34c558': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': 'd8ba626fdf264b879099a89097845153', 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'consumer_generation': 1} on consumer dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.network.neutron [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Instance destroyed successfully.
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'resources' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-514180225',display_name='tempest-VolumesAdminNegativeTest-server-514180225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-514180225',id=20,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwrW/DiMlNF2Ji9Y5iVEQBZtMtRV6Vih4ujw06H39HRo0xW45aPYpYvBV2mUrxJyYo0WpGsoBY7+Fdvab4BKf8lv/2VL0+lT0QPJ8oA5k9l0pJvB0di4++LeVyMOVzPdg==',key_name='tempest-keypair-1911302712',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8c1003f0d1847b7b4c679b0f7cc3110',ramdisk_id='',reservation_id='r-afvfpe08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1593136751',owner_user_name='tempest-VolumesAdminNegativeTest-1593136751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c276268b63084515a43caa837af30fb1',uuid=88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converting VIF {"id": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "address": "fa:16:3e:e8:3b:ed", "network": {"id": "d97ca114-f9d6-4141-b129-1e4f8d50b538", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-724229744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8c1003f0d1847b7b4c679b0f7cc3110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e300fb-a2", "ovs_interfaceid": "40e300fb-a2c9-4770-8eee-d1b48baedf34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_vif [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40e300fb-a2, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:40:40 user nova-compute[82394]: INFO os_vif [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3b:ed,bridge_name='br-int',has_traffic_filtering=True,id=40e300fb-a2c9-4770-8eee-d1b48baedf34,network=Network(d97ca114-f9d6-4141-b129-1e4f8d50b538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e300fb-a2')
Apr 12 00:40:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Deleting instance files /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3_del
Apr 12 00:40:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Deletion of /opt/stack/data/nova/instances/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3_del complete
Apr 12 00:40:40 user nova-compute[82394]: INFO nova.compute.manager [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG nova.network.neutron [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-dbe6d6bc-65a6-469a-89a0-7e4c51620b14" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.utils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc492c9e-4bec-46a0-aa2a-a2d208259b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e61de4-05e5-4b30-9a07-0aa4b4844ed5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7238929f-9623-4f0a-a1c7-a79854b7c862]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7cebd2-eb8f-49f6-ac0f-08fe32b29e65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:40:40 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:40:40 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf9e53-555b-4891-a68f-468e5ae69bde]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:40:40 user nova-compute[82394]: DEBUG os_brick.utils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:41 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Took 0.92 seconds to deallocate network for instance.
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-vif-deleted-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-vif-unplugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] No waiting events found dispatching network-vif-unplugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:41 user nova-compute[82394]: WARNING nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received unexpected event network-vif-unplugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance with vm_state deleted and task_state None.
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Acquiring lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] No waiting events found dispatching network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:41 user nova-compute[82394]: WARNING nova.compute.manager [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Received unexpected event network-vif-plugged-40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance with vm_state deleted and task_state None.
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:41 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Deleted allocations for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3
Apr 12 00:40:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:42 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:40:43 user nova-compute[82394]: INFO nova.compute.claims [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Claim successful on node user
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:40:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.policy [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:40:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Creating image(s)
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.part --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG nova.virt.images [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 2317fabf-b690-45f6-b138-d4e83ea7d334 was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.part /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Successfully created port: d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:40:44 user nova-compute[82394]: INFO nova.compute.claims [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Claim successful on node user
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.part /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.converted" returned: 0 in 0.247s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.092s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json" returned: 0 in 0.167s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5,backing_fmt=raw /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5,backing_fmt=raw /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk 1073741824" returned: 0 in 0.068s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "a0587ed801ac90ccc13c2924fd34da653566d7c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Successfully updated port: d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing instance network info cache due to event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:40:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Cannot resize image /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'migration_context' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Ensure instance console log exists: /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:40:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Creating image(s)
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "/opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Starting finish_revert_migration {{(pid=82394) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start _get_guest_xml network_info=[{"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e9b0e74e-3012-42d7-a962-655df4455624', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14', 'attached_at': '2023-04-12T00:40:45.000000', 'detached_at': '', 'volume_id': '09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'serial': '09c62c76-e1a1-483c-a846-9f5be2dcec9b'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:40:45 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:45 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:40:45 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:40:45 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:40:45 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d18b590-d072-4f3a-a27c-f1bd515692e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.policy [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:40:45 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk 1073741824" returned: 0 in 0.062s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbdb255-aa4e-4433-ae40-fcce01923c8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b] added
Apr 12 00:40:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c91d7-a62b-4b60-add8-7a640a6a1692]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b5c92-9714-4875-a880-996934d0f39a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGdWqpOw" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb857c3-4b3f-4a01-8d0d-c4fa8b65830d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGdWqpOw'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:40:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78833ee-6c92-4a7f-9723-287472f4905b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdaf5b8-a779-424e-98e1-68f94f59837c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ce6bf-c60e-45ec-9ab4-7f9f8cfaab3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:40:46 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:40:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Cannot resize image /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'migration_context' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Ensure instance console log exists: /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d12483-45df-421a-9676-f9e46050e0d7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ed840-1484-4f71-980a-1ec30cfc2978]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:40:46 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:40:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance network_info: |[{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.neutron [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start _get_guest_xml network_info=[{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:40:40Z,direct_url=<?>,disk_format='qcow2',id=2317fabf-b690-45f6-b138-d4e83ea7d334,min_disk=0,min_ram=0,name='tempest-scenario-img--2057268422',owner='e66fda80cb83402392e155c76ee78e1f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:40:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '2317fabf-b690-45f6-b138-d4e83ea7d334'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ae37d-8b05-45db-9f64-758b1f883bec]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:40:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:46 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:40:40Z,direct_url=<?>,disk_format='qcow2',id=2317fabf-b690-45f6-b138-d4e83ea7d334,min_disk=0,min_ram=0,name='tempest-scenario-img--2057268422',owner='e66fda80cb83402392e155c76ee78e1f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:40:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:40:44Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.objects.instance [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'pci_devices' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:40:46 user nova-compute[82394]:   <uuid>c57eddf0-bf85-4b87-a352-57508a728763</uuid>
Apr 12 00:40:46 user nova-compute[82394]:   <name>instance-0000001c</name>
Apr 12 00:40:46 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:40:46 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:40:46 user nova-compute[82394]:   <metadata>
Apr 12 00:40:46 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:40:46 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:name>tempest-TestMinimumBasicScenario-server-4294683</nova:name>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:40:46</nova:creationTime>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:40:46 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:40:46 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:owner>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:user uuid="2842535891eb4a9880f7e8859dd0de3c">tempest-TestMinimumBasicScenario-1682364358-project-member</nova:user>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:project uuid="e66fda80cb83402392e155c76ee78e1f">tempest-TestMinimumBasicScenario-1682364358</nova:project>
Apr 12 00:40:46 user nova-compute[82394]:       </nova:owner>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:root type="image" uuid="2317fabf-b690-45f6-b138-d4e83ea7d334"/>
Apr 12 00:40:46 user nova-compute[82394]:       <nova:ports>
Apr 12 00:40:46 user nova-compute[82394]:         <nova:port uuid="d1cda216-0dbb-4296-81c2-9386697372d2">
Apr 12 00:40:46 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 00:40:46 user nova-compute[82394]:         </nova:port>
Apr 12 00:40:46 user nova-compute[82394]:       </nova:ports>
Apr 12 00:40:46 user nova-compute[82394]:     </nova:instance>
Apr 12 00:40:46 user nova-compute[82394]:   </metadata>
Apr 12 00:40:46 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:40:46 user nova-compute[82394]:     <system>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="serial">c57eddf0-bf85-4b87-a352-57508a728763</entry>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="uuid">c57eddf0-bf85-4b87-a352-57508a728763</entry>
Apr 12 00:40:46 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:40:46 user nova-compute[82394]:     </system>
Apr 12 00:40:46 user nova-compute[82394]:   </sysinfo>
Apr 12 00:40:46 user nova-compute[82394]:   <os>
Apr 12 00:40:46 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:40:46 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:40:46 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:40:46 user nova-compute[82394]:   </os>
Apr 12 00:40:46 user nova-compute[82394]:   <features>
Apr 12 00:40:46 user nova-compute[82394]:     <acpi/>
Apr 12 00:40:46 user nova-compute[82394]:     <apic/>
Apr 12 00:40:46 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:40:46 user nova-compute[82394]:   </features>
Apr 12 00:40:46 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:40:46 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:40:46 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:40:46 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:40:46 user nova-compute[82394]:   </clock>
Apr 12 00:40:46 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:40:46 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:40:46 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:40:46 user nova-compute[82394]:   </cpu>
Apr 12 00:40:46 user nova-compute[82394]:   <devices>
Apr 12 00:40:46 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:40:46 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:40:46 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk"/>
Apr 12 00:40:46 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:40:46 user nova-compute[82394]:     </disk>
Apr 12 00:40:46 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:40:46 user nova-compute[82394]:       <mac address="fa:16:3e:5a:3e:c9"/>
Apr 12 00:40:46 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:46 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:40:46 user nova-compute[82394]:       <target dev="tapd1cda216-0d"/>
Apr 12 00:40:46 user nova-compute[82394]:     </interface>
Apr 12 00:40:46 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:40:46 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/console.log" append="off"/>
Apr 12 00:40:46 user nova-compute[82394]:     </serial>
Apr 12 00:40:46 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:40:46 user nova-compute[82394]:     <video>
Apr 12 00:40:46 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:46 user nova-compute[82394]:     </video>
Apr 12 00:40:46 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:40:46 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:40:46 user nova-compute[82394]:     </rng>
Apr 12 00:40:46 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:40:46 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:40:46 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:40:46 user nova-compute[82394]:     </memballoon>
Apr 12 00:40:46 user nova-compute[82394]:   </devices>
Apr 12 00:40:46 user nova-compute[82394]: </domain>
Apr 12 00:40:46 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:40:44Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG os_vif [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cda216-0d, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cda216-0d, col_values=(('external_ids', {'iface-id': 'd1cda216-0dbb-4296-81c2-9386697372d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:3e:c9', 'vm-uuid': 'c57eddf0-bf85-4b87-a352-57508a728763'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:46 user nova-compute[82394]: INFO os_vif [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d')
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No VIF found with MAC fa:16:3e:5a:3e:c9, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:40:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updated VIF entry in instance network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Successfully created port: f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033376233653362', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:40:47 user nova-compute[82394]:   <uuid>dbe6d6bc-65a6-469a-89a0-7e4c51620b14</uuid>
Apr 12 00:40:47 user nova-compute[82394]:   <name>instance-00000004</name>
Apr 12 00:40:47 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:40:47 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:40:47 user nova-compute[82394]:   <metadata>
Apr 12 00:40:47 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:40:47 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-197146176</nova:name>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:40:45</nova:creationTime>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:40:47 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:40:47 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:owner>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:40:47 user nova-compute[82394]:       </nova:owner>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:40:47 user nova-compute[82394]:       <nova:ports>
Apr 12 00:40:47 user nova-compute[82394]:         <nova:port uuid="b99b54c2-0b21-42ea-91d0-087aa230da7e">
Apr 12 00:40:47 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:40:47 user nova-compute[82394]:         </nova:port>
Apr 12 00:40:47 user nova-compute[82394]:       </nova:ports>
Apr 12 00:40:47 user nova-compute[82394]:     </nova:instance>
Apr 12 00:40:47 user nova-compute[82394]:   </metadata>
Apr 12 00:40:47 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:40:47 user nova-compute[82394]:     <system>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="serial">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="uuid">dbe6d6bc-65a6-469a-89a0-7e4c51620b14</entry>
Apr 12 00:40:47 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:40:47 user nova-compute[82394]:     </system>
Apr 12 00:40:47 user nova-compute[82394]:   </sysinfo>
Apr 12 00:40:47 user nova-compute[82394]:   <os>
Apr 12 00:40:47 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:40:47 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:40:47 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:40:47 user nova-compute[82394]:   </os>
Apr 12 00:40:47 user nova-compute[82394]:   <features>
Apr 12 00:40:47 user nova-compute[82394]:     <acpi/>
Apr 12 00:40:47 user nova-compute[82394]:     <apic/>
Apr 12 00:40:47 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:40:47 user nova-compute[82394]:   </features>
Apr 12 00:40:47 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:40:47 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:40:47 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:40:47 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:40:47 user nova-compute[82394]:   </clock>
Apr 12 00:40:47 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:40:47 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:40:47 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:40:47 user nova-compute[82394]:   </cpu>
Apr 12 00:40:47 user nova-compute[82394]:   <devices>
Apr 12 00:40:47 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:40:47 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:40:47 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk"/>
Apr 12 00:40:47 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:40:47 user nova-compute[82394]:     </disk>
Apr 12 00:40:47 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:40:47 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:40:47 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:40:47 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:40:47 user nova-compute[82394]:       <serial>09c62c76-e1a1-483c-a846-9f5be2dcec9b</serial>
Apr 12 00:40:47 user nova-compute[82394]:     </disk>
Apr 12 00:40:47 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:40:47 user nova-compute[82394]:       <mac address="fa:16:3e:a1:e7:04"/>
Apr 12 00:40:47 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:47 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:40:47 user nova-compute[82394]:       <target dev="tapb99b54c2-0b"/>
Apr 12 00:40:47 user nova-compute[82394]:     </interface>
Apr 12 00:40:47 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:40:47 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/console.log" append="off"/>
Apr 12 00:40:47 user nova-compute[82394]:     </serial>
Apr 12 00:40:47 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:40:47 user nova-compute[82394]:     <video>
Apr 12 00:40:47 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:47 user nova-compute[82394]:     </video>
Apr 12 00:40:47 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:40:47 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:40:47 user nova-compute[82394]:     </rng>
Apr 12 00:40:47 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:40:47 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:40:47 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:40:47 user nova-compute[82394]:     </memballoon>
Apr 12 00:40:47 user nova-compute[82394]:   </devices>
Apr 12 00:40:47 user nova-compute[82394]: </domain>
Apr 12 00:40:47 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG os_vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99b54c2-0b, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb99b54c2-0b, col_values=(('external_ids', {'iface-id': 'b99b54c2-0b21-42ea-91d0-087aa230da7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e7:04', 'vm-uuid': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: INFO os_vif [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Successfully updated port: f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquired lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-changed-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Refreshing instance network info cache due to event network-changed-f34869ea-bee8-482e-a9eb-9d9c7414a17c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Acquiring lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:40:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:48 user nova-compute[82394]: WARNING nova.compute.manager [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state building and task_state spawning.
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updating instance_info_cache with network_info: [{"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Releasing lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Instance network_info: |[{"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Acquired lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Refreshing network info cache for port f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Start _get_guest_xml network_info=[{"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:40:48 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:48 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390611439',display_name='tempest-AttachVolumeNegativeTest-server-390611439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390611439',id=29,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWGj7dSQHVA/HrEtaB4DJigDG9Mzlx8PMjbhwOxrK2TUFxfhn0D8YVV6DDvZ+svIniFEYTa7iGPRsIpVwCvT8L2WyFqHYxb0W0vFI6wRmarN6uFa/j/PlGTywze+bhPSg==',key_name='tempest-keypair-289836934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-gsxienly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=d677c2bb-77e2-40f3-8c3a-f15c9f75276d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'pci_devices' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:40:48 user nova-compute[82394]:   <uuid>d677c2bb-77e2-40f3-8c3a-f15c9f75276d</uuid>
Apr 12 00:40:48 user nova-compute[82394]:   <name>instance-0000001d</name>
Apr 12 00:40:48 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:40:48 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:40:48 user nova-compute[82394]:   <metadata>
Apr 12 00:40:48 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:40:48 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeNegativeTest-server-390611439</nova:name>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:40:48</nova:creationTime>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:40:48 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:40:48 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:owner>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:user uuid="d373f582479c441e8ce9849ca694a186">tempest-AttachVolumeNegativeTest-2076679017-project-member</nova:user>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:project uuid="b56f3c567dc84773a33d596920df727a">tempest-AttachVolumeNegativeTest-2076679017</nova:project>
Apr 12 00:40:48 user nova-compute[82394]:       </nova:owner>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:40:48 user nova-compute[82394]:       <nova:ports>
Apr 12 00:40:48 user nova-compute[82394]:         <nova:port uuid="f34869ea-bee8-482e-a9eb-9d9c7414a17c">
Apr 12 00:40:48 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 00:40:48 user nova-compute[82394]:         </nova:port>
Apr 12 00:40:48 user nova-compute[82394]:       </nova:ports>
Apr 12 00:40:48 user nova-compute[82394]:     </nova:instance>
Apr 12 00:40:48 user nova-compute[82394]:   </metadata>
Apr 12 00:40:48 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:40:48 user nova-compute[82394]:     <system>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="serial">d677c2bb-77e2-40f3-8c3a-f15c9f75276d</entry>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="uuid">d677c2bb-77e2-40f3-8c3a-f15c9f75276d</entry>
Apr 12 00:40:48 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:40:48 user nova-compute[82394]:     </system>
Apr 12 00:40:48 user nova-compute[82394]:   </sysinfo>
Apr 12 00:40:48 user nova-compute[82394]:   <os>
Apr 12 00:40:48 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:40:48 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:40:48 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:40:48 user nova-compute[82394]:   </os>
Apr 12 00:40:48 user nova-compute[82394]:   <features>
Apr 12 00:40:48 user nova-compute[82394]:     <acpi/>
Apr 12 00:40:48 user nova-compute[82394]:     <apic/>
Apr 12 00:40:48 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:40:48 user nova-compute[82394]:   </features>
Apr 12 00:40:48 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:40:48 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:40:48 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:40:48 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:40:48 user nova-compute[82394]:   </clock>
Apr 12 00:40:48 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:40:48 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:40:48 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:40:48 user nova-compute[82394]:   </cpu>
Apr 12 00:40:48 user nova-compute[82394]:   <devices>
Apr 12 00:40:48 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:40:48 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:40:48 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk"/>
Apr 12 00:40:48 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:40:48 user nova-compute[82394]:     </disk>
Apr 12 00:40:48 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:40:48 user nova-compute[82394]:       <mac address="fa:16:3e:2d:14:54"/>
Apr 12 00:40:48 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:48 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:40:48 user nova-compute[82394]:       <target dev="tapf34869ea-be"/>
Apr 12 00:40:48 user nova-compute[82394]:     </interface>
Apr 12 00:40:48 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:40:48 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/console.log" append="off"/>
Apr 12 00:40:48 user nova-compute[82394]:     </serial>
Apr 12 00:40:48 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:40:48 user nova-compute[82394]:     <video>
Apr 12 00:40:48 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:40:48 user nova-compute[82394]:     </video>
Apr 12 00:40:48 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:40:48 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:40:48 user nova-compute[82394]:     </rng>
Apr 12 00:40:48 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:40:48 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:40:48 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:40:48 user nova-compute[82394]:     </memballoon>
Apr 12 00:40:48 user nova-compute[82394]:   </devices>
Apr 12 00:40:48 user nova-compute[82394]: </domain>
Apr 12 00:40:48 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390611439',display_name='tempest-AttachVolumeNegativeTest-server-390611439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390611439',id=29,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWGj7dSQHVA/HrEtaB4DJigDG9Mzlx8PMjbhwOxrK2TUFxfhn0D8YVV6DDvZ+svIniFEYTa7iGPRsIpVwCvT8L2WyFqHYxb0W0vFI6wRmarN6uFa/j/PlGTywze+bhPSg==',key_name='tempest-keypair-289836934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-gsxienly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=d677c2bb-77e2-40f3-8c3a-f15c9f75276d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG os_vif [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34869ea-be, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf34869ea-be, col_values=(('external_ids', {'iface-id': 'f34869ea-bee8-482e-a9eb-9d9c7414a17c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:14:54', 'vm-uuid': 'd677c2bb-77e2-40f3-8c3a-f15c9f75276d'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: INFO os_vif [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be')
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:2d:14:54, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updated VIF entry in instance network info cache for port f34869ea-bee8-482e-a9eb-9d9c7414a17c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updating instance_info_cache with network_info: [{"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Releasing lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:40:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:50 user nova-compute[82394]: WARNING nova.compute.manager [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state building and task_state spawning.
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:50 user nova-compute[82394]: WARNING nova.compute.manager [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state resized and task_state resize_reverting.
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] No waiting events found dispatching network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:51 user nova-compute[82394]: WARNING nova.compute.manager [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received unexpected event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance with vm_state building and task_state spawning.
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260051.9351788, c57eddf0-bf85-4b87-a352-57508a728763 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:51 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] VM Resumed (Lifecycle Event)
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:40:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance spawned successfully.
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:51 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260051.9361043, c57eddf0-bf85-4b87-a352-57508a728763 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:51 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] VM Started (Lifecycle Event)
Apr 12 00:40:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:52 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:40:52 user nova-compute[82394]: INFO nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Took 8.40 seconds to spawn the instance on the hypervisor.
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:52 user nova-compute[82394]: INFO nova.compute.manager [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Took 9.09 seconds to build instance.
Apr 12 00:40:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.197s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260037.9326646, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Stopped (Lifecycle Event)
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-bd40eec7-9fc2-42e7-b70b-f46c0884c2eb None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:52 user nova-compute[82394]: WARNING nova.compute.manager [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state resized and task_state resize_reverting.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] No waiting events found dispatching network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:40:53 user nova-compute[82394]: WARNING nova.compute.manager [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received unexpected event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance with vm_state building and task_state spawning.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260053.2579696, d677c2bb-77e2-40f3-8c3a-f15c9f75276d => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] VM Resumed (Lifecycle Event)
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Instance spawned successfully.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260053.2595189, d677c2bb-77e2-40f3-8c3a-f15c9f75276d => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] VM Started (Lifecycle Event)
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Took 7.92 seconds to spawn the instance on the hypervisor.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance running successfully.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] finish_revert_migration finished successfully. {{(pid=82394) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260053.386896, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Resumed (Lifecycle Event)
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260053.3923113, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Started (Lifecycle Event)
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Took 9.04 seconds to build instance.
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.184s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:53 user nova-compute[82394]: INFO nova.compute.manager [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance to original state: 'active'
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260040.4394324, 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:40:55 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] VM Stopped (Lifecycle Event)
Apr 12 00:40:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-57e62a45-205c-49df-8deb-a0e9ce3d6156 None None] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:40:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:40:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7962MB free_disk=26.31180191040039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c57eddf0-bf85-4b87-a352-57508a728763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:40:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:40:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:40:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:40:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:41:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-changed-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Refreshing instance network info cache due to event network-changed-d71af90a-89b8-414c-9bac-b2a9605aeec5. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Acquiring lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Acquired lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Refreshing network info cache for port d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:16 user nova-compute[82394]: INFO nova.compute.manager [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Terminating instance
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updated VIF entry in instance network info cache for port d71af90a-89b8-414c-9bac-b2a9605aeec5. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updating instance_info_cache with network_info: [{"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Releasing lock "refresh_cache-ecfc9ba1-d560-410d-af55-8d5e578aa00d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-unplugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] No waiting events found dispatching network-vif-unplugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:41:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-unplugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:41:17 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Instance destroyed successfully.
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid ecfc9ba1-d560-410d-af55-8d5e578aa00d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1445873100',display_name='tempest-TestVolumeBootPattern-server-1445873100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1445873100',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-07x9n30r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:39:36Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=ecfc9ba1-d560-410d-af55-8d5e578aa00d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "address": "fa:16:3e:42:41:96", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd71af90a-89", "ovs_interfaceid": "d71af90a-89b8-414c-9bac-b2a9605aeec5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_vif [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd71af90a-89, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:17 user nova-compute[82394]: INFO os_vif [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:41:96,bridge_name='br-int',has_traffic_filtering=True,id=d71af90a-89b8-414c-9bac-b2a9605aeec5,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd71af90a-89')
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:41:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8912f5-6d13-4ed4-a223-351d14354268]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:41:17 user nova-compute[82394]: No targets found.
Apr 12 00:41:17 user nova-compute[82394]: iSNS:
Apr 12 00:41:17 user nova-compute[82394]: No targets found.
Apr 12 00:41:17 user nova-compute[82394]: STATIC:
Apr 12 00:41:17 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:41:17 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:41:17 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:41:17 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:41:17 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:41:17 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:41:17 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:41:17 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:41:17 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:41:17 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:41:17 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:41:17 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:41:17 user nova-compute[82394]: FIRMWARE:
Apr 12 00:41:17 user nova-compute[82394]: No targets found.
Apr 12 00:41:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:41:17 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:41:17 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f1ba47-986f-4857-881f-949bfe31d5b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb15596-5b9e-49ab-9051-547d943cce97]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:41:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:41:17 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:41:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb214247490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b76f65-ea49-4fc7-b28a-fbb2acd085f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e66d5c-0aad-4cb0-87f8-2c43123945cb]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11722e9-16b9-4777-b689-c4bdb2599019]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb6e3b-298b-45d4-a42e-aaeb7e272c0f]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d99e30e-1863-4e8d-9fb7-669db2e13f17]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[113887a9-509e-4cb7-9770-5bfb0b0279c0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]
Apr 12 00:41:17 user nova-compute[82394]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.
Apr 12 00:41:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[837dfc66-deff-4615-854f-393518962812]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (326ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:41:17 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Deleting instance files /opt/stack/data/nova/instances/ecfc9ba1-d560-410d-af55-8d5e578aa00d_del
Apr 12 00:41:17 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Deletion of /opt/stack/data/nova/instances/ecfc9ba1-d560-410d-af55-8d5e578aa00d_del complete
Apr 12 00:41:17 user nova-compute[82394]: INFO nova.compute.manager [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 12 00:41:17 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:41:17 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:41:18 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:41:18 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Took 1.12 seconds to deallocate network for instance.
Apr 12 00:41:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Acquiring lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] No waiting events found dispatching network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:41:18 user nova-compute[82394]: WARNING nova.compute.manager [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received unexpected event network-vif-plugged-d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance with vm_state active and task_state deleting.
Apr 12 00:41:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Received event network-vif-deleted-d71af90a-89b8-414c-9bac-b2a9605aeec5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:19 user nova-compute[82394]: INFO nova.compute.manager [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 00:41:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:19 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:41:19 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:41:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:19 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d
Apr 12 00:41:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "ecfc9ba1-d560-410d-af55-8d5e578aa00d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.512s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:32 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260077.1195545, ecfc9ba1-d560-410d-af55-8d5e578aa00d => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:41:32 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] VM Stopped (Lifecycle Event)
Apr 12 00:41:32 user nova-compute[82394]: DEBUG nova.compute.manager [None req-49d75c45-d1b8-4fbf-861f-3810166731f4 None None] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:41:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:43 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:46 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:41:46 user nova-compute[82394]: INFO nova.compute.claims [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Claim successful on node user
Apr 12 00:41:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:41:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.policy [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d5c08640a8b4472a99ea037612a1332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af94aa5f596c49c08359724ef6780f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:41:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Creating image(s)
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "/opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "/opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "/opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk 1073741824" returned: 0 in 0.057s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:41:47 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Successfully created port: 8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Cannot resize image /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.objects.instance [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lazy-loading 'migration_context' on Instance uuid 334c6825-035f-454c-9804-00ab537f54d1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Ensure instance console log exists: /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Successfully updated port: 8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquired lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-changed-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Refreshing instance network info cache due to event network-changed-8c84814e-5562-4740-8e7a-565fbeefa36f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Acquiring lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:41:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Updating instance_info_cache with network_info: [{"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Releasing lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Instance network_info: |[{"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Acquired lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.neutron [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Refreshing network info cache for port 8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Start _get_guest_xml network_info=[{"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:41:49 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:41:49 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-815753218',display_name='tempest-DeleteServersTestJSON-server-815753218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-815753218',id=30,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af94aa5f596c49c08359724ef6780f94',ramdisk_id='',reservation_id='r-4yebsmd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1834816505',owner_user_name='tempest-DeleteServersTestJSON-1834816505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:41:47Z,user_data=None,user_id='6d5c08640a8b4472a99ea037612a1332',uuid=334c6825-035f-454c-9804-00ab537f54d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converting VIF {"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.objects.instance [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lazy-loading 'pci_devices' on Instance uuid 334c6825-035f-454c-9804-00ab537f54d1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:41:49 user nova-compute[82394]:   <uuid>334c6825-035f-454c-9804-00ab537f54d1</uuid>
Apr 12 00:41:49 user nova-compute[82394]:   <name>instance-0000001e</name>
Apr 12 00:41:49 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:41:49 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:41:49 user nova-compute[82394]:   <metadata>
Apr 12 00:41:49 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:41:49 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:name>tempest-DeleteServersTestJSON-server-815753218</nova:name>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:41:49</nova:creationTime>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:41:49 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:41:49 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:owner>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:user uuid="6d5c08640a8b4472a99ea037612a1332">tempest-DeleteServersTestJSON-1834816505-project-member</nova:user>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:project uuid="af94aa5f596c49c08359724ef6780f94">tempest-DeleteServersTestJSON-1834816505</nova:project>
Apr 12 00:41:49 user nova-compute[82394]:       </nova:owner>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:41:49 user nova-compute[82394]:       <nova:ports>
Apr 12 00:41:49 user nova-compute[82394]:         <nova:port uuid="8c84814e-5562-4740-8e7a-565fbeefa36f">
Apr 12 00:41:49 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 00:41:49 user nova-compute[82394]:         </nova:port>
Apr 12 00:41:49 user nova-compute[82394]:       </nova:ports>
Apr 12 00:41:49 user nova-compute[82394]:     </nova:instance>
Apr 12 00:41:49 user nova-compute[82394]:   </metadata>
Apr 12 00:41:49 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:41:49 user nova-compute[82394]:     <system>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="serial">334c6825-035f-454c-9804-00ab537f54d1</entry>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="uuid">334c6825-035f-454c-9804-00ab537f54d1</entry>
Apr 12 00:41:49 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:41:49 user nova-compute[82394]:     </system>
Apr 12 00:41:49 user nova-compute[82394]:   </sysinfo>
Apr 12 00:41:49 user nova-compute[82394]:   <os>
Apr 12 00:41:49 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:41:49 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:41:49 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:41:49 user nova-compute[82394]:   </os>
Apr 12 00:41:49 user nova-compute[82394]:   <features>
Apr 12 00:41:49 user nova-compute[82394]:     <acpi/>
Apr 12 00:41:49 user nova-compute[82394]:     <apic/>
Apr 12 00:41:49 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:41:49 user nova-compute[82394]:   </features>
Apr 12 00:41:49 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:41:49 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:41:49 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:41:49 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:41:49 user nova-compute[82394]:   </clock>
Apr 12 00:41:49 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:41:49 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:41:49 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:41:49 user nova-compute[82394]:   </cpu>
Apr 12 00:41:49 user nova-compute[82394]:   <devices>
Apr 12 00:41:49 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:41:49 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:41:49 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk"/>
Apr 12 00:41:49 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:41:49 user nova-compute[82394]:     </disk>
Apr 12 00:41:49 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:41:49 user nova-compute[82394]:       <mac address="fa:16:3e:31:20:9e"/>
Apr 12 00:41:49 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:41:49 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:41:49 user nova-compute[82394]:       <target dev="tap8c84814e-55"/>
Apr 12 00:41:49 user nova-compute[82394]:     </interface>
Apr 12 00:41:49 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:41:49 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/console.log" append="off"/>
Apr 12 00:41:49 user nova-compute[82394]:     </serial>
Apr 12 00:41:49 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:41:49 user nova-compute[82394]:     <video>
Apr 12 00:41:49 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:41:49 user nova-compute[82394]:     </video>
Apr 12 00:41:49 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:41:49 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:41:49 user nova-compute[82394]:     </rng>
Apr 12 00:41:49 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:41:49 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:41:49 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:41:49 user nova-compute[82394]:     </memballoon>
Apr 12 00:41:49 user nova-compute[82394]:   </devices>
Apr 12 00:41:49 user nova-compute[82394]: </domain>
Apr 12 00:41:49 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-815753218',display_name='tempest-DeleteServersTestJSON-server-815753218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-815753218',id=30,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af94aa5f596c49c08359724ef6780f94',ramdisk_id='',reservation_id='r-4yebsmd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1834816505',owner_user_name='tempest-DeleteServersTestJSON-1834816505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:41:47Z,user_data=None,user_id='6d5c08640a8b4472a99ea037612a1332',uuid=334c6825-035f-454c-9804-00ab537f54d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converting VIF {"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG os_vif [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c84814e-55, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c84814e-55, col_values=(('external_ids', {'iface-id': '8c84814e-5562-4740-8e7a-565fbeefa36f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:20:9e', 'vm-uuid': '334c6825-035f-454c-9804-00ab537f54d1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:49 user nova-compute[82394]: INFO os_vif [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55')
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] No VIF found with MAC fa:16:3e:31:20:9e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.neutron [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Updated VIF entry in instance network info cache for port 8c84814e-5562-4740-8e7a-565fbeefa36f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG nova.network.neutron [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Updating instance_info_cache with network_info: [{"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Releasing lock "refresh_cache-334c6825-035f-454c-9804-00ab537f54d1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:41:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] No waiting events found dispatching network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:41:50 user nova-compute[82394]: WARNING nova.compute.manager [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received unexpected event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f for instance with vm_state building and task_state spawning.
Apr 12 00:41:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260112.7227783, 334c6825-035f-454c-9804-00ab537f54d1 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] VM Resumed (Lifecycle Event)
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Instance spawned successfully.
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260112.7270606, 334c6825-035f-454c-9804-00ab537f54d1 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] VM Started (Lifecycle Event)
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 12 00:41:52 user nova-compute[82394]: DEBUG nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:41:52 user nova-compute[82394]: INFO nova.compute.manager [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Took 5.99 seconds to build instance.
Apr 12 00:41:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.079s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] No waiting events found dispatching network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:41:53 user nova-compute[82394]: WARNING nova.compute.manager [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received unexpected event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f for instance with vm_state active and task_state None.
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:53 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:41:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:41:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:41:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=26.26923370361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c57eddf0-bf85-4b87-a352-57508a728763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 334c6825-035f-454c-9804-00ab537f54d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:41:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:41:58 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:41:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [{"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:41:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-8d895d64-319f-4c67-8c20-ef0d0437a1f0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:41:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:41:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:07 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:42:08 user nova-compute[82394]: INFO nova.compute.claims [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Claim successful on node user
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:42:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:42:08 user nova-compute[82394]: INFO nova.virt.block_device [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Booting with volume 39255a99-7938-4a08-af09-fe2d718c4fda at /dev/vda
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.policy [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.utils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb3575-186b-4e96-9ae9-7f7e70bb11ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1557a-19e7-4e45-88d6-205662684c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc73a20-ca05-4679-8e20-d94ca899ca7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a41515-d4c3-42d0-943f-c9b7768f2dcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:08 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:42:08 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4736cf3e-7636-4640-ab52-8c63ef286d95]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG os_brick.utils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:08 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating existing volume attachment record: fcaa6fe3-61c5-449a-b722-414f0f27df79 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:42:09 user nova-compute[82394]: INFO nova.compute.manager [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Unrescuing
Apr 12 00:42:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:09 user nova-compute[82394]: DEBUG nova.network.neutron [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:42:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Successfully created port: d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG nova.network.neutron [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG nova.objects.instance [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:10 user nova-compute[82394]: WARNING nova.compute.manager [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:42:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance destroyed successfully.
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Successfully updated port: d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing instance network info cache due to event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Acquiring lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating instance_info_cache with network_info: [{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Instance network_info: |[{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Acquired lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updated VIF entry in instance network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.network.neutron [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating instance_info_cache with network_info: [{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Releasing lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:12 user nova-compute[82394]: WARNING nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:12 user nova-compute[82394]: DEBUG nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:12 user nova-compute[82394]: WARNING nova.compute.manager [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:42:13 user nova-compute[82394]: INFO nova.compute.claims [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Claim successful on node user
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:42:13 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Creating image(s)
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Ensure instance console log exists: /opt/stack/data/nova/instances/533174dc-5071-487b-9a2c-74cd7786af8a/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Start _get_guest_xml network_info=[{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fcaa6fe3-61c5-449a-b722-414f0f27df79', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '533174dc-5071-487b-9a2c-74cd7786af8a', 'attached_at': '', 'detached_at': '', 'volume_id': '39255a99-7938-4a08-af09-fe2d718c4fda', 'serial': '39255a99-7938-4a08-af09-fe2d718c4fda'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:42:13 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:13 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:13 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:13 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:13 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02cabc-10b3-4e50-adb5-563d26117148]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:42:13 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942cab2-8634-42e5-b05e-c7ec679d67a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda] added
Apr 12 00:42:13 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cdaef9-a8dd-4c23-97c4-e549c47e0f7a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fdd23e-5cdb-4b53-8525-6d49059a4940]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVRDsQTE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVRDsQTE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a23ee-964c-4c97-85a7-512b81d96a62]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVRDsQTE'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f24fbd-dab6-43ce-aeca-45ed81eda63d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[00088bfb-bd59-4bf5-8fd5-32dd52110dc7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:13 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:13 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:13 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:13 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:13 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:13 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:13 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:42:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec752f2-841b-4b6a-8d4b-b36be4911587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]
Apr 12 00:42:14 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:14 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[641add2c-3d99-4283-97b2-2c9e3613f625]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.policy [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be770f-2da2-4c75-85b9-2d11d98a9c77]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:14 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:14 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:14 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:42:14 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Creating image(s)
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "/opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db5ae4-e3c3-48b5-9d67-8a7d3cf271cb]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk 1073741824" returned: 0 in 0.059s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 49c8e8b7-1f91-4cf5-a222-c787a186444d due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260134.604852, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:14 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Resumed (Lifecycle Event)
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Successfully created port: 95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:42:14 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260134.6090448, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:14 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Started (Lifecycle Event)
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Cannot resize image /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.objects.instance [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'migration_context' on Instance uuid 77f09d77-815b-4e7c-905d-b27ae017c9d5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.compute.manager [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:14 user nova-compute[82394]: WARNING nova.compute.manager [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state active and task_state None.
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Ensure instance console log exists: /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23633653462336332', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633653462336332', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790407973',display_name='tempest-TestVolumeBootPattern-server-1790407973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1790407973',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-xr9ouv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:42:09Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=533174dc-5071-487b-9a2c-74cd7786af8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid 533174dc-5071-487b-9a2c-74cd7786af8a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:42:15 user nova-compute[82394]:   <uuid>533174dc-5071-487b-9a2c-74cd7786af8a</uuid>
Apr 12 00:42:15 user nova-compute[82394]:   <name>instance-0000001f</name>
Apr 12 00:42:15 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:42:15 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:42:15 user nova-compute[82394]:   <metadata>
Apr 12 00:42:15 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:42:15 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-server-1790407973</nova:name>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:42:13</nova:creationTime>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:42:15 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:owner>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:owner>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:ports>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:port uuid="d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30">
Apr 12 00:42:15 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 00:42:15 user nova-compute[82394]:         </nova:port>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:ports>
Apr 12 00:42:15 user nova-compute[82394]:     </nova:instance>
Apr 12 00:42:15 user nova-compute[82394]:   </metadata>
Apr 12 00:42:15 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:42:15 user nova-compute[82394]:     <system>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="serial">533174dc-5071-487b-9a2c-74cd7786af8a</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="uuid">533174dc-5071-487b-9a2c-74cd7786af8a</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:42:15 user nova-compute[82394]:     </system>
Apr 12 00:42:15 user nova-compute[82394]:   </sysinfo>
Apr 12 00:42:15 user nova-compute[82394]:   <os>
Apr 12 00:42:15 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:42:15 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:42:15 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:42:15 user nova-compute[82394]:   </os>
Apr 12 00:42:15 user nova-compute[82394]:   <features>
Apr 12 00:42:15 user nova-compute[82394]:     <acpi/>
Apr 12 00:42:15 user nova-compute[82394]:     <apic/>
Apr 12 00:42:15 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:42:15 user nova-compute[82394]:   </features>
Apr 12 00:42:15 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:42:15 user nova-compute[82394]:   </clock>
Apr 12 00:42:15 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:42:15 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:42:15 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:42:15 user nova-compute[82394]:   </cpu>
Apr 12 00:42:15 user nova-compute[82394]:   <devices>
Apr 12 00:42:15 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:42:15 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:15 user nova-compute[82394]:       <source dev="/dev/sdd"/>
Apr 12 00:42:15 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:       <serial>39255a99-7938-4a08-af09-fe2d718c4fda</serial>
Apr 12 00:42:15 user nova-compute[82394]:     </disk>
Apr 12 00:42:15 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:42:15 user nova-compute[82394]:       <mac address="fa:16:3e:ad:7d:6f"/>
Apr 12 00:42:15 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:42:15 user nova-compute[82394]:       <target dev="tapd983e69a-5d"/>
Apr 12 00:42:15 user nova-compute[82394]:     </interface>
Apr 12 00:42:15 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:42:15 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/533174dc-5071-487b-9a2c-74cd7786af8a/console.log" append="off"/>
Apr 12 00:42:15 user nova-compute[82394]:     </serial>
Apr 12 00:42:15 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:42:15 user nova-compute[82394]:     <video>
Apr 12 00:42:15 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:     </video>
Apr 12 00:42:15 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:42:15 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:42:15 user nova-compute[82394]:     </rng>
Apr 12 00:42:15 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:42:15 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:42:15 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:42:15 user nova-compute[82394]:     </memballoon>
Apr 12 00:42:15 user nova-compute[82394]:   </devices>
Apr 12 00:42:15 user nova-compute[82394]: </domain>
Apr 12 00:42:15 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790407973',display_name='tempest-TestVolumeBootPattern-server-1790407973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1790407973',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-xr9ouv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:42:09Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=533174dc-5071-487b-9a2c-74cd7786af8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG os_vif [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd983e69a-5d, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd983e69a-5d, col_values=(('external_ids', {'iface-id': 'd983e69a-5d6a-40c9-b4b7-27c6cfa9ea30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:7d:6f', 'vm-uuid': '533174dc-5071-487b-9a2c-74cd7786af8a'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: INFO os_vif [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d')
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:ad:7d:6f, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Successfully updated port: 95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-changed-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Refreshing instance network info cache due to event network-changed-95181ee0-bb75-49a0-ad95-a2c225ff5f51. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Acquiring lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updating instance_info_cache with network_info: [{"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Instance network_info: |[{"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Acquired lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.neutron [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Refreshing network info cache for port 95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Start _get_guest_xml network_info=[{"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:42:15 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:15 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-336796070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-336796070',id=32,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-cst9omcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:42:14Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=77f09d77-815b-4e7c-905d-b27ae017c9d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.objects.instance [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid 77f09d77-815b-4e7c-905d-b27ae017c9d5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:42:15 user nova-compute[82394]:   <uuid>77f09d77-815b-4e7c-905d-b27ae017c9d5</uuid>
Apr 12 00:42:15 user nova-compute[82394]:   <name>instance-00000020</name>
Apr 12 00:42:15 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:42:15 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:42:15 user nova-compute[82394]:   <metadata>
Apr 12 00:42:15 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:42:15 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-336796070</nova:name>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:42:15</nova:creationTime>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:42:15 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:owner>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:owner>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:42:15 user nova-compute[82394]:       <nova:ports>
Apr 12 00:42:15 user nova-compute[82394]:         <nova:port uuid="95181ee0-bb75-49a0-ad95-a2c225ff5f51">
Apr 12 00:42:15 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 00:42:15 user nova-compute[82394]:         </nova:port>
Apr 12 00:42:15 user nova-compute[82394]:       </nova:ports>
Apr 12 00:42:15 user nova-compute[82394]:     </nova:instance>
Apr 12 00:42:15 user nova-compute[82394]:   </metadata>
Apr 12 00:42:15 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:42:15 user nova-compute[82394]:     <system>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="serial">77f09d77-815b-4e7c-905d-b27ae017c9d5</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="uuid">77f09d77-815b-4e7c-905d-b27ae017c9d5</entry>
Apr 12 00:42:15 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:42:15 user nova-compute[82394]:     </system>
Apr 12 00:42:15 user nova-compute[82394]:   </sysinfo>
Apr 12 00:42:15 user nova-compute[82394]:   <os>
Apr 12 00:42:15 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:42:15 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:42:15 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:42:15 user nova-compute[82394]:   </os>
Apr 12 00:42:15 user nova-compute[82394]:   <features>
Apr 12 00:42:15 user nova-compute[82394]:     <acpi/>
Apr 12 00:42:15 user nova-compute[82394]:     <apic/>
Apr 12 00:42:15 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:42:15 user nova-compute[82394]:   </features>
Apr 12 00:42:15 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:42:15 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:42:15 user nova-compute[82394]:   </clock>
Apr 12 00:42:15 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:42:15 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:42:15 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:42:15 user nova-compute[82394]:   </cpu>
Apr 12 00:42:15 user nova-compute[82394]:   <devices>
Apr 12 00:42:15 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:42:15 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:42:15 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk"/>
Apr 12 00:42:15 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:     </disk>
Apr 12 00:42:15 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:42:15 user nova-compute[82394]:       <mac address="fa:16:3e:c3:c5:c8"/>
Apr 12 00:42:15 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:42:15 user nova-compute[82394]:       <target dev="tap95181ee0-bb"/>
Apr 12 00:42:15 user nova-compute[82394]:     </interface>
Apr 12 00:42:15 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:42:15 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/console.log" append="off"/>
Apr 12 00:42:15 user nova-compute[82394]:     </serial>
Apr 12 00:42:15 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:42:15 user nova-compute[82394]:     <video>
Apr 12 00:42:15 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:15 user nova-compute[82394]:     </video>
Apr 12 00:42:15 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:42:15 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:42:15 user nova-compute[82394]:     </rng>
Apr 12 00:42:15 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:42:15 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:42:15 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:42:15 user nova-compute[82394]:     </memballoon>
Apr 12 00:42:15 user nova-compute[82394]:   </devices>
Apr 12 00:42:15 user nova-compute[82394]: </domain>
Apr 12 00:42:15 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-336796070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-336796070',id=32,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-cst9omcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:42:14Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=77f09d77-815b-4e7c-905d-b27ae017c9d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG os_vif [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95181ee0-bb, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95181ee0-bb, col_values=(('external_ids', {'iface-id': '95181ee0-bb75-49a0-ad95-a2c225ff5f51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:c5:c8', 'vm-uuid': '77f09d77-815b-4e7c-905d-b27ae017c9d5'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:42:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:15 user nova-compute[82394]: INFO os_vif [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb')
Apr 12 00:42:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:c3:c5:c8, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updated VIF entry in instance network info cache for port 95181ee0-bb75-49a0-ad95-a2c225ff5f51. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updating instance_info_cache with network_info: [{"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Releasing lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] No waiting events found dispatching network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:17 user nova-compute[82394]: WARNING nova.compute.manager [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received unexpected event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance with vm_state building and task_state spawning.
Apr 12 00:42:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] No waiting events found dispatching network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:18 user nova-compute[82394]: WARNING nova.compute.manager [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received unexpected event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance with vm_state building and task_state spawning.
Apr 12 00:42:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] No waiting events found dispatching network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:19 user nova-compute[82394]: WARNING nova.compute.manager [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received unexpected event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance with vm_state building and task_state spawning.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260140.3051155, 533174dc-5071-487b-9a2c-74cd7786af8a => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] VM Resumed (Lifecycle Event)
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Instance spawned successfully.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260140.3098934, 533174dc-5071-487b-9a2c-74cd7786af8a => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] VM Started (Lifecycle Event)
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Took 6.69 seconds to spawn the instance on the hypervisor.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] No waiting events found dispatching network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:20 user nova-compute[82394]: WARNING nova.compute.manager [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received unexpected event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance with vm_state building and task_state spawning.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260140.4733438, 77f09d77-815b-4e7c-905d-b27ae017c9d5 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] VM Resumed (Lifecycle Event)
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Instance spawned successfully.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260140.4745252, 77f09d77-815b-4e7c-905d-b27ae017c9d5 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] VM Started (Lifecycle Event)
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Took 12.57 seconds to build instance.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.691s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Took 6.52 seconds to spawn the instance on the hypervisor.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:20 user nova-compute[82394]: INFO nova.compute.manager [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Took 7.36 seconds to build instance.
Apr 12 00:42:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.458s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:42:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-changed-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Refreshing instance network info cache due to event network-changed-f34869ea-bee8-482e-a9eb-9d9c7414a17c. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Acquiring lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Acquired lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.network.neutron [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Refreshing network info cache for port f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Attaching volume 08438351-ef8b-444d-ad94-8d60d0c47d37 to /dev/vdb
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.utils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a6650-5121-4571-b037-1f98f1f8b98a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1406836-dc2c-4ded-98a2-59efd6839ff5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e94011-f870-42a3-8fe2-0d42850d71fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5e8978-214b-4495-a1b2-f4ad4ec12c35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:35 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[caccc4d8-bdff-42dc-972a-feca28ed36b9]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG os_brick.utils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating existing volume attachment record: 024b1344-eb61-418c-93f2-1bc4c495835a {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.network.neutron [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updated VIF entry in instance network info cache for port f34869ea-bee8-482e-a9eb-9d9c7414a17c. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG nova.network.neutron [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updating instance_info_cache with network_info: [{"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Releasing lock "refresh_cache-d677c2bb-77e2-40f3-8c3a-f15c9f75276d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG nova.objects.instance [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:36 user nova-compute[82394]: INFO nova.compute.manager [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Attaching volume 50b34a7a-9231-479c-9aa8-98fa4691a883 to /dev/vdb
Apr 12 00:42:36 user nova-compute[82394]: DEBUG os_brick.utils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29119c-bfc8-4bbd-b8be-77cb9d4ded0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c34d53e-7772-4611-a063-91a061db63b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833c8dd-45a5-4780-bdd4-f1807da4d417]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37dd500-2b84-4827-9f60-0367b149887d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:42:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:42:37 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:42:37 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a7956e-9745-4f24-b3cf-b1e261398403]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG os_brick.utils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:37 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updating existing volume attachment record: 6ee54f7d-e494-44d5-a01d-0bb8ebaa4878 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:39 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:39 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:39 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e62a9e-9cdd-404a-9331-7df00ebbc0b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:42:39 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb96f7b-f32f-4ec8-a8fc-722254cc784c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37] added
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660f342-40ed-4f58-a4df-938473f3982c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d594d423-6b4c-4d35-8ddb-1c0a7240165d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLhxgcCU {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLhxgcCU" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd23f9d-dc3c-47ce-be9c-7e5359186fe6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLhxgcCU'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a8bba-4da4-468f-a7f5-a2b5275a29ed]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[74251531-4a6c-41e9-9975-5c8d8a8e55d7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323f307-cb45-47eb-b68b-5d9edaedd3f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]
Apr 12 00:42:39 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b1176-6d28-47ba-8580-4ca2c0e01ad5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a663fae-6088-4521-ae47-140624ced5c7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:39 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:39 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd195cbb-7df1-4ae3-8aee-bba9b8f7ee27]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:42:39 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23139643933306164', 'path': '/dev/sdf'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643933306164', 'path': '/dev/sdf'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:42:40 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:40 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:42:40 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:42:40 user nova-compute[82394]:   <serial>08438351-ef8b-444d-ad94-8d60d0c47d37</serial>
Apr 12 00:42:40 user nova-compute[82394]: </disk>
Apr 12 00:42:40 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLflGRvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:41 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:41 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:41 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da087e-e27d-4f58-8c38-6352e99da77b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:42:41 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e69e91-99e0-4762-b9d9-5c80a8647ad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883] added
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabc5699-d8c7-4dfa-9a65-89ceae2dcb90]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8843dfbc-89d0-4c5a-ac72-7f685805270f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLflGRvM {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLflGRvM" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb5786-c2c7-4db9-934c-d6a97526f9e0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLflGRvM'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca70ea78-4f0a-4f85-9af8-ef468d79a4f5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd419ec6-ef01-46b9-9710-83b11c38aca1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[41442b16-193c-41f7-b62f-4c4170f14fd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260]
Apr 12 00:42:41 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No VIF found with MAC fa:16:3e:5a:3e:c9, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d546b-9f56-4f5d-a22d-955c499cd027]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6143f662-6a7b-496d-b493-c6b8b9bf7b6c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)
Apr 12 00:42:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d8023b-bcff-407a-a206-9466b45bb1f1]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:42:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.408s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLflGRvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23963646532386639', 'path': '/dev/sdg'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646532386639', 'path': '/dev/sdg'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:42:42 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:42 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:42:42 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:42:42 user nova-compute[82394]:   <serial>50b34a7a-9231-479c-9aa8-98fa4691a883</serial>
Apr 12 00:42:42 user nova-compute[82394]: </disk>
Apr 12 00:42:42 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:42:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:2d:14:54, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:42:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.255s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:43 user nova-compute[82394]: INFO nova.compute.manager [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Detaching volume 50b34a7a-9231-479c-9aa8-98fa4691a883
Apr 12 00:42:43 user nova-compute[82394]: INFO nova.virt.block_device [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Attempting to driver detach volume 50b34a7a-9231-479c-9aa8-98fa4691a883 from mountpoint /dev/vdb
Apr 12 00:42:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Attempting to detach device vdb from instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:42:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:42:43 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:43 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:42:43 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:42:43 user nova-compute[82394]:   <serial>50b34a7a-9231-479c-9aa8-98fa4691a883</serial>
Apr 12 00:42:43 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:42:43 user nova-compute[82394]: </disk>
Apr 12 00:42:43 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:42:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d from the persistent domain config.
Apr 12 00:42:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:42:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:42:43 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:43 user nova-compute[82394]:   <source dev="/dev/sdg"/>
Apr 12 00:42:43 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:42:43 user nova-compute[82394]:   <serial>50b34a7a-9231-479c-9aa8-98fa4691a883</serial>
Apr 12 00:42:43 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:42:43 user nova-compute[82394]: </disk>
Apr 12 00:42:43 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260164.1931663, d677c2bb-77e2-40f3-8c3a-f15c9f75276d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:42:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d from the live domain config.
Apr 12 00:42:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLflGRvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:44 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647602a-339a-4931-a9a0-e7bdda1b121b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:42:44 user nova-compute[82394]: No targets found.
Apr 12 00:42:44 user nova-compute[82394]: iSNS:
Apr 12 00:42:44 user nova-compute[82394]: No targets found.
Apr 12 00:42:44 user nova-compute[82394]: STATIC:
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:42:44 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:44 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:44 user nova-compute[82394]: FIRMWARE:
Apr 12 00:42:44 user nova-compute[82394]: No targets found.
Apr 12 00:42:44 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:42:44 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:42:44 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a791baa8-054e-4433-9215-77cddad097b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f0b5b-910a-478f-a54f-ccdd6fe3f594]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 (non-flash)
Apr 12 00:42:44 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb234462680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883'): ({'sdg'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Removing single pathed devices sdg {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeba6c1-def9-4c99-a79d-912ba0c51c5d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a48a104-8530-4249-a1ec-f824b0c29c59]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flushing IO for device /dev/sdg {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0051668-98dc-4982-9eff-ec73231fbe31]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c16f5-4df1-4586-b892-1bf960889b06]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] SCSI volumes sdg have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1b803-bab7-4557-9f9c-3cf371ad59f1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ad586d-9bdb-4b1b-ab58-e8fde7f2d7c2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260]
Apr 12 00:42:44 user nova-compute[82394]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:44 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b34a7a-9231-479c-9aa8-98fa4691a883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff5968e-067e-49eb-9057-c1831096f35a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== disconnect_volume: return (305ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:42:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:42:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing instance network info cache due to event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG nova.network.neutron [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG nova.network.neutron [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updated VIF entry in instance network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG nova.network.neutron [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG nova.compute.manager [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing instance network info cache due to event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updated VIF entry in instance network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:49 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:42:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:49 user nova-compute[82394]: INFO nova.compute.manager [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Rebooting instance
Apr 12 00:42:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:42:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:42:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:50 user nova-compute[82394]: WARNING nova.compute.manager [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 00:42:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance destroyed successfully.
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'resources' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:42:50Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cda216-0d, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:51 user nova-compute[82394]: INFO os_vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d')
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[37022fda-616a-457c-bcd2-34406df276a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:42:51 user nova-compute[82394]: No targets found.
Apr 12 00:42:51 user nova-compute[82394]: iSNS:
Apr 12 00:42:51 user nova-compute[82394]: No targets found.
Apr 12 00:42:51 user nova-compute[82394]: STATIC:
Apr 12 00:42:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:42:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:42:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:42:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:42:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:42:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:42:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:42:51 user nova-compute[82394]: FIRMWARE:
Apr 12 00:42:51 user nova-compute[82394]: No targets found.
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:42:51 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:42:51 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c8a2df-b446-48d2-83e4-d8ede2bd3d12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4270b1-6c4d-4b3d-ab48-64f388804961]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fbe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37'): ({'sdf'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Removing single pathed devices sdf {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d350b5-bce4-4e34-8b96-c2f3f6047a69]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f535de73-0ca1-4b46-b850-fbd8d5e8dd70]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flushing IO for device /dev/sdf {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6decdd0-f4d1-4ecd-85de-ac9d60db8198]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4af8c8-f951-4a1f-8829-994758087942]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa57cd6-f160-48a7-bb9c-00c5c0bbbcf6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3add8c4f-0e59-44c6-8eaf-3b948c1ca274]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]
Apr 12 00:42:51 user nova-compute[82394]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[33855aeb-cc98-4d20-9d94-da17e10a465a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== disconnect_volume: return (336ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start _get_guest_xml network_info=[{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2317fabf-b690-45f6-b138-d4e83ea7d334,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '2317fabf-b690-45f6-b138-d4e83ea7d334'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '024b1344-eb61-418c-93f2-1bc4c495835a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'c57eddf0-bf85-4b87-a352-57508a728763', 'attached_at': '', 'detached_at': '', 'volume_id': '08438351-ef8b-444d-ad94-8d60d0c47d37', 'serial': '08438351-ef8b-444d-ad94-8d60d0c47d37'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:42:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:51 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2317fabf-b690-45f6-b138-d4e83ea7d334,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'vcpu_model' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:42:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:42:51 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff03a7-707b-4347-85a3-2705c1f263ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:42:51 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c4d975-cd17-413c-b3fa-66d877d85231]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37] added
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94c1ce2-7335-4655-8345-e844dc9e87e7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72c10b-79c3-4506-bedb-e797b1f33aaf]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLhxgcCU {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLhxgcCU" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c2725-b8c7-43cd-9466-ec6657b79fcd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLhxgcCU'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd33b4b-4cec-4aec-855d-a884f8a03ea2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5917a-d5fb-4326-a3cc-f33a3050b40d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c008cc-f6ed-4715-aeb8-0ff6c0d210a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]
Apr 12 00:42:51 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.
Apr 12 00:42:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7484cf-2681-41b5-a48d-3ff0e86e93a6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0217b6e-46a8-426c-bbcd-3f0c0fe399fa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:42:52 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:42:52 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705d01b-1579-4096-b6a8-4c9229a8ea2e]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:52 user nova-compute[82394]: WARNING nova.compute.manager [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 00:42:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23139643933306164', 'path': '/dev/sdf'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643933306164', 'path': '/dev/sdf'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:42:50Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'pci_devices' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:42:53 user nova-compute[82394]:   <uuid>c57eddf0-bf85-4b87-a352-57508a728763</uuid>
Apr 12 00:42:53 user nova-compute[82394]:   <name>instance-0000001c</name>
Apr 12 00:42:53 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:42:53 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:42:53 user nova-compute[82394]:   <metadata>
Apr 12 00:42:53 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:42:53 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:name>tempest-TestMinimumBasicScenario-server-4294683</nova:name>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:42:51</nova:creationTime>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:42:53 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:42:53 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:owner>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:user uuid="2842535891eb4a9880f7e8859dd0de3c">tempest-TestMinimumBasicScenario-1682364358-project-member</nova:user>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:project uuid="e66fda80cb83402392e155c76ee78e1f">tempest-TestMinimumBasicScenario-1682364358</nova:project>
Apr 12 00:42:53 user nova-compute[82394]:       </nova:owner>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:root type="image" uuid="2317fabf-b690-45f6-b138-d4e83ea7d334"/>
Apr 12 00:42:53 user nova-compute[82394]:       <nova:ports>
Apr 12 00:42:53 user nova-compute[82394]:         <nova:port uuid="d1cda216-0dbb-4296-81c2-9386697372d2">
Apr 12 00:42:53 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 00:42:53 user nova-compute[82394]:         </nova:port>
Apr 12 00:42:53 user nova-compute[82394]:       </nova:ports>
Apr 12 00:42:53 user nova-compute[82394]:     </nova:instance>
Apr 12 00:42:53 user nova-compute[82394]:   </metadata>
Apr 12 00:42:53 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:42:53 user nova-compute[82394]:     <system>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="serial">c57eddf0-bf85-4b87-a352-57508a728763</entry>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="uuid">c57eddf0-bf85-4b87-a352-57508a728763</entry>
Apr 12 00:42:53 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:42:53 user nova-compute[82394]:     </system>
Apr 12 00:42:53 user nova-compute[82394]:   </sysinfo>
Apr 12 00:42:53 user nova-compute[82394]:   <os>
Apr 12 00:42:53 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:42:53 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:42:53 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:42:53 user nova-compute[82394]:   </os>
Apr 12 00:42:53 user nova-compute[82394]:   <features>
Apr 12 00:42:53 user nova-compute[82394]:     <acpi/>
Apr 12 00:42:53 user nova-compute[82394]:     <apic/>
Apr 12 00:42:53 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:42:53 user nova-compute[82394]:   </features>
Apr 12 00:42:53 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:42:53 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:42:53 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:42:53 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:42:53 user nova-compute[82394]:   </clock>
Apr 12 00:42:53 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:42:53 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:42:53 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:42:53 user nova-compute[82394]:   </cpu>
Apr 12 00:42:53 user nova-compute[82394]:   <devices>
Apr 12 00:42:53 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:42:53 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:42:53 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk"/>
Apr 12 00:42:53 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:42:53 user nova-compute[82394]:     </disk>
Apr 12 00:42:53 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:42:53 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:42:53 user nova-compute[82394]:       <source dev="/dev/sdf"/>
Apr 12 00:42:53 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:42:53 user nova-compute[82394]:       <serial>08438351-ef8b-444d-ad94-8d60d0c47d37</serial>
Apr 12 00:42:53 user nova-compute[82394]:     </disk>
Apr 12 00:42:53 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:42:53 user nova-compute[82394]:       <mac address="fa:16:3e:5a:3e:c9"/>
Apr 12 00:42:53 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:53 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:42:53 user nova-compute[82394]:       <target dev="tapd1cda216-0d"/>
Apr 12 00:42:53 user nova-compute[82394]:     </interface>
Apr 12 00:42:53 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:42:53 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/console.log" append="off"/>
Apr 12 00:42:53 user nova-compute[82394]:     </serial>
Apr 12 00:42:53 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:42:53 user nova-compute[82394]:     <video>
Apr 12 00:42:53 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:42:53 user nova-compute[82394]:     </video>
Apr 12 00:42:53 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:42:53 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:42:53 user nova-compute[82394]:     </rng>
Apr 12 00:42:53 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:42:53 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:42:53 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:42:53 user nova-compute[82394]:     </memballoon>
Apr 12 00:42:53 user nova-compute[82394]:   </devices>
Apr 12 00:42:53 user nova-compute[82394]: </domain>
Apr 12 00:42:53 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'trusted_certs' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Cannot resize image /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'migration_context' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:42:50Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG os_vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cda216-0d, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cda216-0d, col_values=(('external_ids', {'iface-id': 'd1cda216-0dbb-4296-81c2-9386697372d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:3e:c9', 'vm-uuid': 'c57eddf0-bf85-4b87-a352-57508a728763'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:42:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:53 user nova-compute[82394]: INFO os_vif [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d')
Apr 12 00:42:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:42:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:42:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:55 user nova-compute[82394]: WARNING nova.compute.manager [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for c57eddf0-bf85-4b87-a352-57508a728763 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260177.2060468, c57eddf0-bf85-4b87-a352-57508a728763 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] VM Resumed (Lifecycle Event)
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:42:57 user nova-compute[82394]: WARNING nova.compute.manager [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 00:42:57 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance rebooted successfully.
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260177.2095761, c57eddf0-bf85-4b87-a352-57508a728763 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:42:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] VM Started (Lifecycle Event)
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:42:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.501s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:42:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:42:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7603MB free_disk=26.235843658447266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c57eddf0-bf85-4b87-a352-57508a728763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 334c6825-035f-454c-9804-00ab537f54d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 533174dc-5071-487b-9a2c-74cd7786af8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:42:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:43:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:43:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [{"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:43:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:43:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:43:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:27 user nova-compute[82394]: INFO nova.compute.manager [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Terminating instance
Apr 12 00:43:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-unplugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:43:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Instance destroyed successfully.
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1087783512',display_name='tempest-ServerActionsTestJSON-server-197146176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1087783512',id=4,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-eiap4xd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=dbe6d6bc-65a6-469a-89a0-7e4c51620b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "address": "fa:16:3e:a1:e7:04", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99b54c2-0b", "ovs_interfaceid": "b99b54c2-0b21-42ea-91d0-087aa230da7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_vif [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99b54c2-0b, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:43:28 user nova-compute[82394]: INFO os_vif [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e7:04,bridge_name='br-int',has_traffic_filtering=True,id=b99b54c2-0b21-42ea-91d0-087aa230da7e,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99b54c2-0b')
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGdWqpOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:43:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b2194-4891-4aa6-8b7f-8cc8487c7335]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:43:28 user nova-compute[82394]: No targets found.
Apr 12 00:43:28 user nova-compute[82394]: iSNS:
Apr 12 00:43:28 user nova-compute[82394]: No targets found.
Apr 12 00:43:28 user nova-compute[82394]: STATIC:
Apr 12 00:43:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b
Apr 12 00:43:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:43:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:43:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:43:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:43:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:28 user nova-compute[82394]: FIRMWARE:
Apr 12 00:43:28 user nova-compute[82394]: No targets found.
Apr 12 00:43:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:43:28 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:43:28 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ce714-a7f7-4fc9-9628-bb4e01965273]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44b9d43-5d11-44fb-a567-c4fb306d05a1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:28 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fbd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98b64f-8a6f-4c7b-a40f-ef56340419c7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[78431a7f-ad5c-4c56-87a6-2f45f446ba2b]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba84e1d1-1356-429d-aee6-a7c09373c4c7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a8735-81c1-47ad-aeef-b646f7660429]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2760a8-4f9c-4a04-b4e3-04587c962229]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf0838-97ce-40c3-9eea-16daceb09fbb]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260]
Apr 12 00:43:28 user nova-compute[82394]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b, portal: 172.16.0.220,3260] successful.
Apr 12 00:43:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c62c76-e1a1-483c-a846-9f5be2dcec9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebecae2-ee40-4385-bd05-a611ea012b04]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (315ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:43:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Deleting instance files /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_del
Apr 12 00:43:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Deletion of /opt/stack/data/nova/instances/dbe6d6bc-65a6-469a-89a0-7e4c51620b14_del complete
Apr 12 00:43:28 user nova-compute[82394]: INFO nova.compute.manager [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 00:43:28 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:43:28 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:43:29 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Took 0.85 seconds to deallocate network for instance.
Apr 12 00:43:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-deleted-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Acquiring lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:29 user nova-compute[82394]: DEBUG nova.compute.manager [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] No waiting events found dispatching network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:29 user nova-compute[82394]: WARNING nova.compute.manager [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Received unexpected event network-vif-plugged-b99b54c2-0b21-42ea-91d0-087aa230da7e for instance with vm_state active and task_state deleting.
Apr 12 00:43:30 user nova-compute[82394]: INFO nova.compute.manager [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Took 0.89 seconds to detach 1 volumes for instance.
Apr 12 00:43:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:30 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:43:30 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:43:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:30 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Deleted allocations for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14
Apr 12 00:43:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "dbe6d6bc-65a6-469a-89a0-7e4c51620b14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.478s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:34 user nova-compute[82394]: INFO nova.compute.manager [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Terminating instance
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-unplugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] No waiting events found dispatching network-vif-unplugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-unplugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:43:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Instance destroyed successfully.
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'resources' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390611439',display_name='tempest-AttachVolumeNegativeTest-server-390611439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390611439',id=29,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWGj7dSQHVA/HrEtaB4DJigDG9Mzlx8PMjbhwOxrK2TUFxfhn0D8YVV6DDvZ+svIniFEYTa7iGPRsIpVwCvT8L2WyFqHYxb0W0vFI6wRmarN6uFa/j/PlGTywze+bhPSg==',key_name='tempest-keypair-289836934',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-gsxienly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=d677c2bb-77e2-40f3-8c3a-f15c9f75276d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "address": "fa:16:3e:2d:14:54", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34869ea-be", "ovs_interfaceid": "f34869ea-bee8-482e-a9eb-9d9c7414a17c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG os_vif [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34869ea-be, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:43:34 user nova-compute[82394]: INFO os_vif [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:14:54,bridge_name='br-int',has_traffic_filtering=True,id=f34869ea-bee8-482e-a9eb-9d9c7414a17c,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34869ea-be')
Apr 12 00:43:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Deleting instance files /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d_del
Apr 12 00:43:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Deletion of /opt/stack/data/nova/instances/d677c2bb-77e2-40f3-8c3a-f15c9f75276d_del complete
Apr 12 00:43:34 user nova-compute[82394]: INFO nova.compute.manager [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 00:43:34 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:43:34 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:43:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:35 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:43:35 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Took 0.98 seconds to deallocate network for instance.
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:36 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Deleted allocations for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d
Apr 12 00:43:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Acquiring lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] No waiting events found dispatching network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:36 user nova-compute[82394]: WARNING nova.compute.manager [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received unexpected event network-vif-plugged-f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance with vm_state deleted and task_state None.
Apr 12 00:43:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Received event network-vif-deleted-f34869ea-bee8-482e-a9eb-9d9c7414a17c {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "d677c2bb-77e2-40f3-8c3a-f15c9f75276d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG nova.objects.instance [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lazy-loading 'flavor' on Instance uuid 334c6825-035f-454c-9804-00ab537f54d1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:38 user nova-compute[82394]: INFO nova.compute.manager [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Attaching volume 1eb43ca0-b670-4380-a916-3b9305fdcb5f to /dev/vdb
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.utils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7619a-f010-4a69-89ed-36c259a06caf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a8781-d2d2-4143-92a0-42dc825166df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d081e-2bd0-4770-aa3a-32b1ad452094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c67e4-c826-43d6-af06-7c7ad6b2ec13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:43:38 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:43:38 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f849df2-582d-4f91-9124-50c336e5cc89]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG os_brick.utils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:43:38 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Updating existing volume attachment record: 9e344581-19ad-4363-a0c4-39f3ed1e97fc {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:43:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAJDtUZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:43:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:43:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:43:42 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3686d027-6876-4ed1-aab5-183f5f715a1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:43:42 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d4888-70ee-4da3-b895-940837bf6c57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f] added
Apr 12 00:43:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7016fae3-bfe7-4a7d-a66d-e10ec24153d3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e74bb-dd32-497b-9d41-41f527c4cf41]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAJDtUZL {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAJDtUZL" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[10574fc4-4fc4-4218-a1b9-8e2900b0c2bc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lAJDtUZL'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8bb8d-52a7-4d6d-ae12-8fba9b1371e0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c7260b-ad71-4254-9867-22e4a06113a8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:42 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:43:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6e94f-28a0-4b09-bca8-d4c22c2c7e89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260]
Apr 12 00:43:43 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260] successful.
Apr 12 00:43:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff2741-beef-4361-a827-5292585fbe9b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5838c3b8-86fd-46f5-adc3-d8db00d4ec8d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)
Apr 12 00:43:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:43 user nova-compute[82394]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)
Apr 12 00:43:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8de68e-4b9d-4205-bdf3-067753753fc0]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:43:43 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260208.335063, dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:43:43 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] VM Stopped (Lifecycle Event)
Apr 12 00:43:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6a070716-b98e-407c-b43e-537335eb76a2 None None] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAJDtUZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23661326263636261', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661326263636261', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.objects.instance [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lazy-loading 'flavor' on Instance uuid 334c6825-035f-454c-9804-00ab537f54d1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:43:44 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:43:44 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:43:44 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:43:44 user nova-compute[82394]:   <serial>1eb43ca0-b670-4380-a916-3b9305fdcb5f</serial>
Apr 12 00:43:44 user nova-compute[82394]: </disk>
Apr 12 00:43:44 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] No VIF found with MAC fa:16:3e:31:20:9e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.160s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:45 user nova-compute[82394]: INFO nova.compute.manager [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Terminating instance
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-unplugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] No waiting events found dispatching network-vif-unplugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-unplugged-8c84814e-5562-4740-8e7a-565fbeefa36f for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Instance destroyed successfully.
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lazy-loading 'resources' on Instance uuid 334c6825-035f-454c-9804-00ab537f54d1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-815753218',display_name='tempest-DeleteServersTestJSON-server-815753218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-815753218',id=30,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af94aa5f596c49c08359724ef6780f94',ramdisk_id='',reservation_id='r-4yebsmd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1834816505',owner_user_name='tempest-DeleteServersTestJSON-1834816505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:41:53Z,user_data=None,user_id='6d5c08640a8b4472a99ea037612a1332',uuid=334c6825-035f-454c-9804-00ab537f54d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converting VIF {"id": "8c84814e-5562-4740-8e7a-565fbeefa36f", "address": "fa:16:3e:31:20:9e", "network": {"id": "3dfa9dbc-d877-4862-b0c4-315d842bc2de", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505046471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af94aa5f596c49c08359724ef6780f94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c84814e-55", "ovs_interfaceid": "8c84814e-5562-4740-8e7a-565fbeefa36f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_vif [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c84814e-55, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:43:45 user nova-compute[82394]: INFO os_vif [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:20:9e,bridge_name='br-int',has_traffic_filtering=True,id=8c84814e-5562-4740-8e7a-565fbeefa36f,network=Network(3dfa9dbc-d877-4862-b0c4-315d842bc2de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c84814e-55')
Apr 12 00:43:45 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAJDtUZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:43:45 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b3be6c-af92-4fde-a726-0dd821fdba6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:43:45 user nova-compute[82394]: No targets found.
Apr 12 00:43:45 user nova-compute[82394]: iSNS:
Apr 12 00:43:45 user nova-compute[82394]: No targets found.
Apr 12 00:43:45 user nova-compute[82394]: STATIC:
Apr 12 00:43:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f
Apr 12 00:43:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:43:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:43:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:43:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:45 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:43:45 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:43:45 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:43:45 user nova-compute[82394]: FIRMWARE:
Apr 12 00:43:45 user nova-compute[82394]: No targets found.
Apr 12 00:43:45 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:43:45 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:43:45 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1942d-5089-46ab-86c8-2f48e99f4376]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:45 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23b4d7-b7b7-4e39-94f3-7374c2ee199f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)
Apr 12 00:43:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:43:46 user nova-compute[82394]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f (non-flash)
Apr 12 00:43:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c85ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c639f-2ec2-42b3-9dad-00d38f1e3b39]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f1f9a-0645-4413-be0a-89f3f18ee68f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[189da327-6d0a-4c7b-81d4-9c2e33919b08]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d861ee-86c7-468b-ac36-caf40e472470]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba727174-21c1-43d7-95f2-88df16cff75f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b26a391-bc17-44b9-95fe-4d6d72517a2f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260]
Apr 12 00:43:46 user nova-compute[82394]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f, portal: 172.16.0.220,3260] successful.
Apr 12 00:43:46 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb43ca0-b670-4380-a916-3b9305fdcb5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d2bfb-4d9f-4c94-ba15-c705debe0efb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] <== disconnect_volume: return (307ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:43:46 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Deleting instance files /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1_del
Apr 12 00:43:46 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Deletion of /opt/stack/data/nova/instances/334c6825-035f-454c-9804-00ab537f54d1_del complete
Apr 12 00:43:46 user nova-compute[82394]: INFO nova.compute.manager [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:46 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:43:46 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Took 0.54 seconds to deallocate network for instance.
Apr 12 00:43:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-deleted-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Acquiring lock "334c6825-035f-454c-9804-00ab537f54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Lock "334c6825-035f-454c-9804-00ab537f54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] No waiting events found dispatching network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:43:47 user nova-compute[82394]: WARNING nova.compute.manager [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Received unexpected event network-vif-plugged-8c84814e-5562-4740-8e7a-565fbeefa36f for instance with vm_state active and task_state deleting.
Apr 12 00:43:47 user nova-compute[82394]: INFO nova.compute.manager [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 00:43:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:48 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:43:48 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:43:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:48 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Deleted allocations for instance 334c6825-035f-454c-9804-00ab537f54d1
Apr 12 00:43:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "334c6825-035f-454c-9804-00ab537f54d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.057s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:49 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260214.8701532, d677c2bb-77e2-40f3-8c3a-f15c9f75276d => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:43:49 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] VM Stopped (Lifecycle Event)
Apr 12 00:43:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1ae3c1ef-0374-47ee-b427-98d23623781c None None] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:43:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:43:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:54 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:43:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:43:57 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=26.29296875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c57eddf0-bf85-4b87-a352-57508a728763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 533174dc-5071-487b-9a2c-74cd7786af8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:43:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:43:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing instance network info cache due to event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Acquiring lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Acquired lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:43:59 user nova-compute[82394]: DEBUG nova.network.neutron [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.compute.manager [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing instance network info cache due to event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updated VIF entry in instance network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating instance_info_cache with network_info: [{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Releasing lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:00 user nova-compute[82394]: INFO nova.compute.manager [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Detaching volume 41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:44:00 user nova-compute[82394]: INFO nova.virt.block_device [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Attempting to driver detach volume 41a82ec2-4e13-4a4b-980f-66064c4ec035 from mountpoint /dev/vdb
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260225.8980682, 334c6825-035f-454c-9804-00ab537f54d1 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:00 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 334c6825-035f-454c-9804-00ab537f54d1] VM Stopped (Lifecycle Event)
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Attempting to detach device vdb from instance 49c8e8b7-1f91-4cf5-a222-c787a186444d from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:44:00 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:44:00 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:44:00 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:44:00 user nova-compute[82394]:   <serial>41a82ec2-4e13-4a4b-980f-66064c4ec035</serial>
Apr 12 00:44:00 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:44:00 user nova-compute[82394]: </disk>
Apr 12 00:44:00 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:44:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully detached device vdb from instance 49c8e8b7-1f91-4cf5-a222-c787a186444d from the persistent domain config.
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49c8e8b7-1f91-4cf5-a222-c787a186444d from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:44:00 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:44:00 user nova-compute[82394]:   <source dev="/dev/sde"/>
Apr 12 00:44:00 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:44:00 user nova-compute[82394]:   <serial>41a82ec2-4e13-4a4b-980f-66064c4ec035</serial>
Apr 12 00:44:00 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:44:00 user nova-compute[82394]: </disk>
Apr 12 00:44:00 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-80151fd8-46de-4f1e-9af7-f34cbc2df647 None None] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updated VIF entry in instance network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG nova.network.neutron [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260241.3838737, 49c8e8b7-1f91-4cf5-a222-c787a186444d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:44:01 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully detached device vdb from instance 49c8e8b7-1f91-4cf5-a222-c787a186444d from the live domain config.
Apr 12 00:44:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWqQYTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:44:01 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ae4c0-c72c-4b20-ac65-ccf9d61fb074]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:44:01 user nova-compute[82394]: No targets found.
Apr 12 00:44:01 user nova-compute[82394]: iSNS:
Apr 12 00:44:01 user nova-compute[82394]: No targets found.
Apr 12 00:44:01 user nova-compute[82394]: STATIC:
Apr 12 00:44:01 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:44:01 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:01 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:01 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035
Apr 12 00:44:01 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:01 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:01 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:44:01 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:01 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:01 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:44:01 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:01 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:01 user nova-compute[82394]: FIRMWARE:
Apr 12 00:44:01 user nova-compute[82394]: No targets found.
Apr 12 00:44:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:44:01 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:44:01 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bffb282-8931-4a60-b85f-d68f5c359bf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6de2e7-7357-4c33-90e5-364e3f2a3ff2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:01 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2142d7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035'): ({'sde'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Removing single pathed devices sde {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669ba91-f58c-466f-9b67-006871352031]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c35c08-df01-479c-aa4b-9814ed328eda]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flushing IO for device /dev/sde {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ce9ba7-7ff1-4aea-b06c-761ebf1f2178]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e92e3-9676-4466-bca1-946c9a7f1760]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87de890-2ea1-4aef-8a0b-ef8aa8d881e1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c381f-a6d7-4500-b631-fa47276c5ef4]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260]
Apr 12 00:44:01 user nova-compute[82394]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035, portal: 172.16.0.220,3260] successful.
Apr 12 00:44:01 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a82ec2-4e13-4a4b-980f-66064c4ec035 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383d87a-2f63-4301-a47e-c810b1a4cc4c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] <== disconnect_volume: return (298ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:44:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing instance network info cache due to event network-changed-a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Acquiring lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Acquired lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Refreshing network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.768s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updated VIF entry in instance network info cache for port a2a25522-be49-4ac7-9893-d030dc2d87ab. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [{"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Releasing lock "refresh_cache-49c8e8b7-1f91-4cf5-a222-c787a186444d" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:04 user nova-compute[82394]: INFO nova.compute.manager [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] instance snapshotting
Apr 12 00:44:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Beginning live snapshot process
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7.delta 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7.delta 1073741824" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:44:05 user nova-compute[82394]: INFO nova.compute.claims [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Claim successful on node user
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:44:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:44:05 user nova-compute[82394]: INFO nova.virt.block_device [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Booting with volume f4d47a21-91ca-485b-8642-8e74639fdb62 at /dev/vda
Apr 12 00:44:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.policy [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[67504a40-1732-4f62-b285-3020e11ba4c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593c1e7-ed50-4d5e-8bbf-830d031a2b9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8f6cb-946a-43a6-a0e0-352121aeae0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[152701d3-87b2-4335-b0a5-6923c5c27078]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:44:05 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:44:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b08653-9be9-48d9-bd35-c7c008fa779d]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== get_connector_properties: return (297ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating existing volume attachment record: 9e22a4c8-3623-4d83-b80b-589e985cf406 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:44:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:44:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 00:44:06 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:44:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7.delta /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7.delta /opt/stack/data/nova/instances/snapshots/tmpzsixvq3v/788459e3d35342abb2ad31d1b8f8dfc7" returned: 0 in 0.453s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Snapshot extracted, beginning image upload
Apr 12 00:44:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Successfully created port: 6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Successfully updated port: 6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquired lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing instance network info cache due to event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Acquiring lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Releasing lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Instance network_info: |[{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Acquired lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updated VIF entry in instance network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Releasing lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:08 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Snapshot image upload complete
Apr 12 00:44:08 user nova-compute[82394]: INFO nova.compute.manager [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Took 4.75 seconds to snapshot the instance on the hypervisor.
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:44:10 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Creating image(s)
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Ensure instance console log exists: /opt/stack/data/nova/instances/e5d898c2-8548-4b32-829e-6afa11e1985f/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Start _get_guest_xml network_info=[{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9e22a4c8-3623-4d83-b80b-589e985cf406', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSXhFgba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5d898c2-8548-4b32-829e-6afa11e1985f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4d47a21-91ca-485b-8642-8e74639fdb62', 'serial': 'f4d47a21-91ca-485b-8642-8e74639fdb62'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:44:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSXhFgba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:44:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:44:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:44:10 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3418e73-2f2a-4cf9-adda-d12cf76562ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:44:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cfc193-31a7-4d23-8998-cfad7af43b33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62] added
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ac042-e64e-403d-8e7b-c4848b42eedc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40eeb0-4d70-4afb-89c1-1307c1f52b8b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSXhFgba {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSXhFgba" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[444904fc-c0e7-4869-baf1-5cb9c2b7e6c6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSXhFgba'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c46b89-9db5-4a6f-84f1-1cb64321fac2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f72543-a2ba-4ef2-aeb1-19c886d3dde8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8495c325-b62a-4672-bb6e-323dbdafcb57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260]
Apr 12 00:44:10 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260] successful.
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[100db2da-e06d-44d4-b99b-6329a6961736]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92042e4b-6c8a-46e0-97e7-6229f3ef5946]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:44:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af420a2b-1346-4054-afa3-bc651250166b]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSXhFgba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:44:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23331616336623137', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331616336623137', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2006086526',display_name='tempest-TestVolumeBootPattern-server-2006086526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2006086526',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-1l6oyngt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:06Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=e5d898c2-8548-4b32-829e-6afa11e1985f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.objects.instance [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'pci_devices' on Instance uuid e5d898c2-8548-4b32-829e-6afa11e1985f {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:44:11 user nova-compute[82394]:   <uuid>e5d898c2-8548-4b32-829e-6afa11e1985f</uuid>
Apr 12 00:44:11 user nova-compute[82394]:   <name>instance-00000021</name>
Apr 12 00:44:11 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:44:11 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:44:11 user nova-compute[82394]:   <metadata>
Apr 12 00:44:11 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:44:11 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:44:11 user nova-compute[82394]:       <nova:name>tempest-TestVolumeBootPattern-server-2006086526</nova:name>
Apr 12 00:44:11 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:44:10</nova:creationTime>
Apr 12 00:44:11 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:44:11 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:44:11 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:44:11 user nova-compute[82394]:       <nova:owner>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:user uuid="c479f6ae2f0d40908be9b07717ca3509">tempest-TestVolumeBootPattern-726466832-project-member</nova:user>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:project uuid="e38a98bf1d964ee6bd2d0d05e97a283a">tempest-TestVolumeBootPattern-726466832</nova:project>
Apr 12 00:44:11 user nova-compute[82394]:       </nova:owner>
Apr 12 00:44:11 user nova-compute[82394]:       <nova:ports>
Apr 12 00:44:11 user nova-compute[82394]:         <nova:port uuid="6578df38-44dd-4f35-943f-b2da72deea5f">
Apr 12 00:44:11 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 00:44:11 user nova-compute[82394]:         </nova:port>
Apr 12 00:44:11 user nova-compute[82394]:       </nova:ports>
Apr 12 00:44:11 user nova-compute[82394]:     </nova:instance>
Apr 12 00:44:11 user nova-compute[82394]:   </metadata>
Apr 12 00:44:11 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:44:11 user nova-compute[82394]:     <system>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="serial">e5d898c2-8548-4b32-829e-6afa11e1985f</entry>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="uuid">e5d898c2-8548-4b32-829e-6afa11e1985f</entry>
Apr 12 00:44:11 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:44:11 user nova-compute[82394]:     </system>
Apr 12 00:44:11 user nova-compute[82394]:   </sysinfo>
Apr 12 00:44:11 user nova-compute[82394]:   <os>
Apr 12 00:44:11 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:44:11 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:44:11 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:44:11 user nova-compute[82394]:   </os>
Apr 12 00:44:11 user nova-compute[82394]:   <features>
Apr 12 00:44:11 user nova-compute[82394]:     <acpi/>
Apr 12 00:44:11 user nova-compute[82394]:     <apic/>
Apr 12 00:44:11 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:44:11 user nova-compute[82394]:   </features>
Apr 12 00:44:11 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:44:11 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:44:11 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:44:11 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:44:11 user nova-compute[82394]:   </clock>
Apr 12 00:44:11 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:44:11 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:44:11 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:44:11 user nova-compute[82394]:   </cpu>
Apr 12 00:44:11 user nova-compute[82394]:   <devices>
Apr 12 00:44:11 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:44:11 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:44:11 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:44:11 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:44:11 user nova-compute[82394]:       <serial>f4d47a21-91ca-485b-8642-8e74639fdb62</serial>
Apr 12 00:44:11 user nova-compute[82394]:     </disk>
Apr 12 00:44:11 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:44:11 user nova-compute[82394]:       <mac address="fa:16:3e:e4:01:29"/>
Apr 12 00:44:11 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:11 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:44:11 user nova-compute[82394]:       <target dev="tap6578df38-44"/>
Apr 12 00:44:11 user nova-compute[82394]:     </interface>
Apr 12 00:44:11 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:44:11 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/e5d898c2-8548-4b32-829e-6afa11e1985f/console.log" append="off"/>
Apr 12 00:44:11 user nova-compute[82394]:     </serial>
Apr 12 00:44:11 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:44:11 user nova-compute[82394]:     <video>
Apr 12 00:44:11 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:11 user nova-compute[82394]:     </video>
Apr 12 00:44:11 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:44:11 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:44:11 user nova-compute[82394]:     </rng>
Apr 12 00:44:11 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:44:11 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:44:11 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:44:11 user nova-compute[82394]:     </memballoon>
Apr 12 00:44:11 user nova-compute[82394]:   </devices>
Apr 12 00:44:11 user nova-compute[82394]: </domain>
Apr 12 00:44:11 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2006086526',display_name='tempest-TestVolumeBootPattern-server-2006086526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2006086526',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-1l6oyngt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:06Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=e5d898c2-8548-4b32-829e-6afa11e1985f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG os_vif [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6578df38-44, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6578df38-44, col_values=(('external_ids', {'iface-id': '6578df38-44dd-4f35-943f-b2da72deea5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:01:29', 'vm-uuid': 'e5d898c2-8548-4b32-829e-6afa11e1985f'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:11 user nova-compute[82394]: INFO os_vif [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44')
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:44:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] No VIF found with MAC fa:16:3e:e4:01:29, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] No waiting events found dispatching network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:13 user nova-compute[82394]: WARNING nova.compute.manager [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received unexpected event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f for instance with vm_state building and task_state spawning.
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260255.1889985, e5d898c2-8548-4b32-829e-6afa11e1985f => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] VM Resumed (Lifecycle Event)
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Instance spawned successfully.
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260255.1911712, e5d898c2-8548-4b32-829e-6afa11e1985f => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] VM Started (Lifecycle Event)
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] No waiting events found dispatching network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:15 user nova-compute[82394]: WARNING nova.compute.manager [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received unexpected event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f for instance with vm_state building and task_state spawning.
Apr 12 00:44:15 user nova-compute[82394]: INFO nova.compute.manager [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Took 10.38 seconds to build instance.
Apr 12 00:44:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.494s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:44:19 user nova-compute[82394]: INFO nova.compute.claims [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Claim successful on node user
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:44:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.policy [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:44:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Creating image(s)
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "/opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "/opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.165s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk 1073741824" returned: 0 in 0.050s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Successfully created port: df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Cannot resize image /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'migration_context' on Instance uuid 84861eef-6d59-448b-b6b7-eb8dd8e47b30 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Ensure instance console log exists: /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Successfully updated port: df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing instance network info cache due to event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Acquiring lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Instance network_info: |[{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Acquired lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Start _get_guest_xml network_info=[{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:44:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1988870830',display_name='tempest-ServerActionsTestJSON-server-1988870830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1988870830',id=34,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-j7kk5no6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=84861eef-6d59-448b-b6b7-eb8dd8e47b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid 84861eef-6d59-448b-b6b7-eb8dd8e47b30 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:44:21 user nova-compute[82394]:   <uuid>84861eef-6d59-448b-b6b7-eb8dd8e47b30</uuid>
Apr 12 00:44:21 user nova-compute[82394]:   <name>instance-00000022</name>
Apr 12 00:44:21 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:44:21 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:44:21 user nova-compute[82394]:   <metadata>
Apr 12 00:44:21 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:44:21 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-1988870830</nova:name>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:44:21</nova:creationTime>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:44:21 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:44:21 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:owner>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:44:21 user nova-compute[82394]:       </nova:owner>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:44:21 user nova-compute[82394]:       <nova:ports>
Apr 12 00:44:21 user nova-compute[82394]:         <nova:port uuid="df061f79-7574-4b3c-9cf4-2b0e61c5efc1">
Apr 12 00:44:21 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 00:44:21 user nova-compute[82394]:         </nova:port>
Apr 12 00:44:21 user nova-compute[82394]:       </nova:ports>
Apr 12 00:44:21 user nova-compute[82394]:     </nova:instance>
Apr 12 00:44:21 user nova-compute[82394]:   </metadata>
Apr 12 00:44:21 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:44:21 user nova-compute[82394]:     <system>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="serial">84861eef-6d59-448b-b6b7-eb8dd8e47b30</entry>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="uuid">84861eef-6d59-448b-b6b7-eb8dd8e47b30</entry>
Apr 12 00:44:21 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:44:21 user nova-compute[82394]:     </system>
Apr 12 00:44:21 user nova-compute[82394]:   </sysinfo>
Apr 12 00:44:21 user nova-compute[82394]:   <os>
Apr 12 00:44:21 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:44:21 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:44:21 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:44:21 user nova-compute[82394]:   </os>
Apr 12 00:44:21 user nova-compute[82394]:   <features>
Apr 12 00:44:21 user nova-compute[82394]:     <acpi/>
Apr 12 00:44:21 user nova-compute[82394]:     <apic/>
Apr 12 00:44:21 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:44:21 user nova-compute[82394]:   </features>
Apr 12 00:44:21 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:44:21 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:44:21 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:44:21 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:44:21 user nova-compute[82394]:   </clock>
Apr 12 00:44:21 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:44:21 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:44:21 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:44:21 user nova-compute[82394]:   </cpu>
Apr 12 00:44:21 user nova-compute[82394]:   <devices>
Apr 12 00:44:21 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:44:21 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:44:21 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk"/>
Apr 12 00:44:21 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:44:21 user nova-compute[82394]:     </disk>
Apr 12 00:44:21 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:44:21 user nova-compute[82394]:       <mac address="fa:16:3e:80:83:ee"/>
Apr 12 00:44:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:21 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:44:21 user nova-compute[82394]:       <target dev="tapdf061f79-75"/>
Apr 12 00:44:21 user nova-compute[82394]:     </interface>
Apr 12 00:44:21 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:44:21 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/console.log" append="off"/>
Apr 12 00:44:21 user nova-compute[82394]:     </serial>
Apr 12 00:44:21 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:44:21 user nova-compute[82394]:     <video>
Apr 12 00:44:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:21 user nova-compute[82394]:     </video>
Apr 12 00:44:21 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:44:21 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:44:21 user nova-compute[82394]:     </rng>
Apr 12 00:44:21 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:44:21 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:44:21 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:44:21 user nova-compute[82394]:     </memballoon>
Apr 12 00:44:21 user nova-compute[82394]:   </devices>
Apr 12 00:44:21 user nova-compute[82394]: </domain>
Apr 12 00:44:21 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1988870830',display_name='tempest-ServerActionsTestJSON-server-1988870830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1988870830',id=34,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-j7kk5no6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=84861eef-6d59-448b-b6b7-eb8dd8e47b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG os_vif [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf061f79-75, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf061f79-75, col_values=(('external_ids', {'iface-id': 'df061f79-7574-4b3c-9cf4-2b0e61c5efc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:83:ee', 'vm-uuid': '84861eef-6d59-448b-b6b7-eb8dd8e47b30'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:21 user nova-compute[82394]: INFO os_vif [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75')
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:44:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:80:83:ee, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:44:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updated VIF entry in instance network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:22 user nova-compute[82394]: DEBUG nova.network.neutron [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Releasing lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] No waiting events found dispatching network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:23 user nova-compute[82394]: WARNING nova.compute.manager [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received unexpected event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance with vm_state building and task_state spawning.
Apr 12 00:44:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] No waiting events found dispatching network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:25 user nova-compute[82394]: WARNING nova.compute.manager [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received unexpected event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance with vm_state building and task_state spawning.
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260265.582194, 84861eef-6d59-448b-b6b7-eb8dd8e47b30 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] VM Resumed (Lifecycle Event)
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Instance spawned successfully.
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260265.5833886, 84861eef-6d59-448b-b6b7-eb8dd8e47b30 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] VM Started (Lifecycle Event)
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 12 00:44:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:25 user nova-compute[82394]: INFO nova.compute.manager [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Took 6.62 seconds to build instance.
Apr 12 00:44:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.722s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:44:28 user nova-compute[82394]: INFO nova.compute.claims [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Claim successful on node user
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:44:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:44:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Creating image(s)
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "/opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "/opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.policy [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.155s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk 1073741824" returned: 0 in 0.052s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Cannot resize image /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'migration_context' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Ensure instance console log exists: /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Successfully created port: 9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Successfully updated port: 9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquired lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-changed-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Refreshing instance network info cache due to event network-changed-9457e7d7-925c-4488-bb2d-c3019a663c42. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Acquiring lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updating instance_info_cache with network_info: [{"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Releasing lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Instance network_info: |[{"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Acquired lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Refreshing network info cache for port 9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Start _get_guest_xml network_info=[{"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:44:31 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:31 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76911330',display_name='tempest-AttachVolumeNegativeTest-server-76911330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76911330',id=35,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWoOc9Cok7OCIn0o1ylURWNrc9FLpoUoG9E4RofMhXE1/xPXUgETixtUirX7kgwq6Uda1/WtQ6DD3WITd65+7Csn8D/LyAnrosTmYHnnOaA6qNkD8YhaIhIQMvIVTLvXA==',key_name='tempest-keypair-1507461507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-0060ozg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=a346a131-2502-457a-acb8-8f903a7b87a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'pci_devices' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:44:31 user nova-compute[82394]:   <uuid>a346a131-2502-457a-acb8-8f903a7b87a7</uuid>
Apr 12 00:44:31 user nova-compute[82394]:   <name>instance-00000023</name>
Apr 12 00:44:31 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:44:31 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:44:31 user nova-compute[82394]:   <metadata>
Apr 12 00:44:31 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:44:31 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeNegativeTest-server-76911330</nova:name>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:44:31</nova:creationTime>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:44:31 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:44:31 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:owner>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:user uuid="d373f582479c441e8ce9849ca694a186">tempest-AttachVolumeNegativeTest-2076679017-project-member</nova:user>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:project uuid="b56f3c567dc84773a33d596920df727a">tempest-AttachVolumeNegativeTest-2076679017</nova:project>
Apr 12 00:44:31 user nova-compute[82394]:       </nova:owner>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:44:31 user nova-compute[82394]:       <nova:ports>
Apr 12 00:44:31 user nova-compute[82394]:         <nova:port uuid="9457e7d7-925c-4488-bb2d-c3019a663c42">
Apr 12 00:44:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 00:44:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:44:31 user nova-compute[82394]:       </nova:ports>
Apr 12 00:44:31 user nova-compute[82394]:     </nova:instance>
Apr 12 00:44:31 user nova-compute[82394]:   </metadata>
Apr 12 00:44:31 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:44:31 user nova-compute[82394]:     <system>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="serial">a346a131-2502-457a-acb8-8f903a7b87a7</entry>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="uuid">a346a131-2502-457a-acb8-8f903a7b87a7</entry>
Apr 12 00:44:31 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:44:31 user nova-compute[82394]:     </system>
Apr 12 00:44:31 user nova-compute[82394]:   </sysinfo>
Apr 12 00:44:31 user nova-compute[82394]:   <os>
Apr 12 00:44:31 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:44:31 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:44:31 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:44:31 user nova-compute[82394]:   </os>
Apr 12 00:44:31 user nova-compute[82394]:   <features>
Apr 12 00:44:31 user nova-compute[82394]:     <acpi/>
Apr 12 00:44:31 user nova-compute[82394]:     <apic/>
Apr 12 00:44:31 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:44:31 user nova-compute[82394]:   </features>
Apr 12 00:44:31 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:44:31 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:44:31 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:44:31 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:44:31 user nova-compute[82394]:   </clock>
Apr 12 00:44:31 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:44:31 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:44:31 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:44:31 user nova-compute[82394]:   </cpu>
Apr 12 00:44:31 user nova-compute[82394]:   <devices>
Apr 12 00:44:31 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:44:31 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:44:31 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk"/>
Apr 12 00:44:31 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:44:31 user nova-compute[82394]:     </disk>
Apr 12 00:44:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:44:31 user nova-compute[82394]:       <mac address="fa:16:3e:a6:b6:43"/>
Apr 12 00:44:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:44:31 user nova-compute[82394]:       <target dev="tap9457e7d7-92"/>
Apr 12 00:44:31 user nova-compute[82394]:     </interface>
Apr 12 00:44:31 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:44:31 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/console.log" append="off"/>
Apr 12 00:44:31 user nova-compute[82394]:     </serial>
Apr 12 00:44:31 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:44:31 user nova-compute[82394]:     <video>
Apr 12 00:44:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:44:31 user nova-compute[82394]:     </video>
Apr 12 00:44:31 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:44:31 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:44:31 user nova-compute[82394]:     </rng>
Apr 12 00:44:31 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:44:31 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:44:31 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:44:31 user nova-compute[82394]:     </memballoon>
Apr 12 00:44:31 user nova-compute[82394]:   </devices>
Apr 12 00:44:31 user nova-compute[82394]: </domain>
Apr 12 00:44:31 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76911330',display_name='tempest-AttachVolumeNegativeTest-server-76911330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76911330',id=35,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWoOc9Cok7OCIn0o1ylURWNrc9FLpoUoG9E4RofMhXE1/xPXUgETixtUirX7kgwq6Uda1/WtQ6DD3WITd65+7Csn8D/LyAnrosTmYHnnOaA6qNkD8YhaIhIQMvIVTLvXA==',key_name='tempest-keypair-1507461507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-0060ozg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=a346a131-2502-457a-acb8-8f903a7b87a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG os_vif [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9457e7d7-92, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9457e7d7-92, col_values=(('external_ids', {'iface-id': '9457e7d7-925c-4488-bb2d-c3019a663c42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:b6:43', 'vm-uuid': 'a346a131-2502-457a-acb8-8f903a7b87a7'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:31 user nova-compute[82394]: INFO os_vif [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92')
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:a6:b6:43, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updated VIF entry in instance network info cache for port 9457e7d7-925c-4488-bb2d-c3019a663c42. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updating instance_info_cache with network_info: [{"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Releasing lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:32 user nova-compute[82394]: DEBUG nova.compute.manager [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] No waiting events found dispatching network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:32 user nova-compute[82394]: WARNING nova.compute.manager [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received unexpected event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 for instance with vm_state building and task_state spawning.
Apr 12 00:44:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260274.5827954, a346a131-2502-457a-acb8-8f903a7b87a7 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] VM Resumed (Lifecycle Event)
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Instance spawned successfully.
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260274.5864687, a346a131-2502-457a-acb8-8f903a7b87a7 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] VM Started (Lifecycle Event)
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:44:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Took 6.57 seconds to build instance.
Apr 12 00:44:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.674s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] No waiting events found dispatching network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:34 user nova-compute[82394]: WARNING nova.compute.manager [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received unexpected event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 for instance with vm_state active and task_state None.
Apr 12 00:44:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing instance network info cache due to event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:41 user nova-compute[82394]: DEBUG nova.network.neutron [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updated VIF entry in instance network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:42 user nova-compute[82394]: INFO nova.compute.manager [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Detaching volume 08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:44:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:42 user nova-compute[82394]: INFO nova.virt.block_device [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Attempting to driver detach volume 08438351-ef8b-444d-ad94-8d60d0c47d37 from mountpoint /dev/vdb
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Attempting to detach device vdb from instance c57eddf0-bf85-4b87-a352-57508a728763 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:44:42 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:44:42 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:44:42 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:44:42 user nova-compute[82394]:   <serial>08438351-ef8b-444d-ad94-8d60d0c47d37</serial>
Apr 12 00:44:42 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:44:42 user nova-compute[82394]: </disk>
Apr 12 00:44:42 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:44:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully detached device vdb from instance c57eddf0-bf85-4b87-a352-57508a728763 from the persistent domain config.
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c57eddf0-bf85-4b87-a352-57508a728763 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:44:42 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:44:42 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:44:42 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:44:42 user nova-compute[82394]:   <serial>08438351-ef8b-444d-ad94-8d60d0c47d37</serial>
Apr 12 00:44:42 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:44:42 user nova-compute[82394]: </disk>
Apr 12 00:44:42 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260282.838383, c57eddf0-bf85-4b87-a352-57508a728763 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:44:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully detached device vdb from instance c57eddf0-bf85-4b87-a352-57508a728763 from the live domain config.
Apr 12 00:44:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLhxgcCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:44:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[350eb1b4-18cf-4975-8b36-573fc85c5c5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:44:42 user nova-compute[82394]: No targets found.
Apr 12 00:44:42 user nova-compute[82394]: iSNS:
Apr 12 00:44:42 user nova-compute[82394]: No targets found.
Apr 12 00:44:42 user nova-compute[82394]: STATIC:
Apr 12 00:44:42 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37
Apr 12 00:44:42 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:42 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:42 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62
Apr 12 00:44:42 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:42 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:42 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:44:42 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:42 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:42 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:44:42 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:44:42 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:44:42 user nova-compute[82394]: FIRMWARE:
Apr 12 00:44:42 user nova-compute[82394]: No targets found.
Apr 12 00:44:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:44:42 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:44:42 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57565c0-d6f0-4286-b322-ff569978ceae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd76391-52f6-4a94-8349-daa5f8bd05c2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:44:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb243c32e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37'): ({'sdf'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Removing single pathed devices sdf {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1127e32a-a640-4652-a419-200cb3c633a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25bf015-9852-44bf-99d5-24c80267c9f5]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flushing IO for device /dev/sdf {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae0849-ae80-4ad5-aced-f4c22584d243]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1836602-7ef8-42b2-a10c-cdbaea281641]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7399119b-bbf6-4a4f-ac75-d30148ad80cb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd148c0-b4ec-4b3e-ae24-beece5eb7538]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260]
Apr 12 00:44:43 user nova-compute[82394]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37, portal: 172.16.0.220,3260] successful.
Apr 12 00:44:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08438351-ef8b-444d-ad94-8d60d0c47d37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0686d181-73a3-4d0a-bf20-692dbd89aaee]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== disconnect_volume: return (364ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing instance network info cache due to event network-changed-d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Acquiring lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Acquired lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.network.neutron [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Refreshing network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.network.neutron [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updated VIF entry in instance network info cache for port d1cda216-0dbb-4296-81c2-9386697372d2. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG nova.network.neutron [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [{"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Releasing lock "refresh_cache-c57eddf0-bf85-4b87-a352-57508a728763" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:44:44 user nova-compute[82394]: DEBUG nova.objects.instance [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.945s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:46 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:51 user nova-compute[82394]: INFO nova.compute.manager [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Terminating instance
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-unplugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Instance destroyed successfully.
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1581384647',display_name='tempest-ServerRescueNegativeTestJSON-server-1581384647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1581384647',id=26,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcEUBZp/r0Qr+iXZ7VL0L/sg/DlCeGc9XiO7Mbog1Rn8MLmZsv660DZ2ywYiThGWPYBU7SmwQ5EYhiLYCMFIdiItGknXyBfY++d6oZR6/JM9QXgkOzqORWBqeFGCztcw==',key_name='tempest-keypair-936664235',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-b6l1ni5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b9421443b2f421298a934122c6a8b8c',uuid=49c8e8b7-1f91-4cf5-a222-c787a186444d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "address": "fa:16:3e:ce:56:00", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a25522-be", "ovs_interfaceid": "a2a25522-be49-4ac7-9893-d030dc2d87ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG os_vif [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2a25522-be, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:44:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:51 user nova-compute[82394]: INFO os_vif [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:56:00,bridge_name='br-int',has_traffic_filtering=True,id=a2a25522-be49-4ac7-9893-d030dc2d87ab,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a25522-be')
Apr 12 00:44:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Deleting instance files /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d_del
Apr 12 00:44:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Deletion of /opt/stack/data/nova/instances/49c8e8b7-1f91-4cf5-a222-c787a186444d_del complete
Apr 12 00:44:52 user nova-compute[82394]: INFO nova.compute.manager [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 00:44:52 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Took 0.77 seconds to deallocate network for instance.
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-deleted-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:52 user nova-compute[82394]: INFO nova.compute.manager [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Neutron deleted interface a2a25522-be49-4ac7-9893-d030dc2d87ab; detaching it from the instance and deleting it from the info cache
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.network.neutron [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Detach interface failed, port_id=a2a25522-be49-4ac7-9893-d030dc2d87ab, reason: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:53 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Deleted allocations for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Acquiring lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Lock "49c8e8b7-1f91-4cf5-a222-c787a186444d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] No waiting events found dispatching network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:44:53 user nova-compute[82394]: WARNING nova.compute.manager [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Received unexpected event network-vif-plugged-a2a25522-be49-4ac7-9893-d030dc2d87ab for instance with vm_state deleted and task_state None.
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:44:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:44:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:44:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:59 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=26.223472595214844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c57eddf0-bf85-4b87-a352-57508a728763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 533174dc-5071-487b-9a2c-74cd7786af8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance e5d898c2-8548-4b32-829e-6afa11e1985f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a346a131-2502-457a-acb8-8f903a7b87a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:44:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:45:00 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:45:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:45:00 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:45:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:45:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:06 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260291.9588423, 49c8e8b7-1f91-4cf5-a222-c787a186444d => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:45:06 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] VM Stopped (Lifecycle Event)
Apr 12 00:45:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62d9f231-a0fe-48a8-abe1-207a7bc6594c None None] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:45:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:10 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:45:10 user nova-compute[82394]: INFO nova.compute.claims [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Claim successful on node user
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:45:11 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:45:11 user nova-compute[82394]: INFO nova.virt.block_device [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Booting with volume-backed-image 7ae54858-7fe8-4bde-be8c-1b0f88b691ea at /dev/vda
Apr 12 00:45:11 user nova-compute[82394]: DEBUG nova.policy [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:45:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:12 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Successfully created port: 2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Successfully updated port: 2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-changed-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG nova.compute.manager [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Refreshing instance network info cache due to event network-changed-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Acquiring lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:45:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating instance_info_cache with network_info: [{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance network_info: |[{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Acquired lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Refreshing network info cache for port 2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updated VIF entry in instance network info cache for port 2f72a2ec-42e3-4239-bf22-a5ecc61aedcf. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG nova.network.neutron [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating instance_info_cache with network_info: [{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Releasing lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:45:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.utils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ed34a-360b-43d0-b0b0-6c44da9883b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d8317-4ceb-48ea-bfe3-fd3452c207cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[482b07ee-cd54-4e23-88f7-a6a9458a634c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[141a486b-cfa4-4818-b91c-df30c75df71c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:45:17 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:45:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62015e7-d0b4-4786-8b45-aea2f2c3f0ed]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG os_brick.utils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:45:17 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating existing volume attachment record: 77f028a0-edbf-41dc-a086-e62244db6b47 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:45:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Creating image(s)
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start _get_guest_xml network_info=[{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77f028a0-edbf-41dc-a086-e62244db6b47', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0c7ca20-c237-43b0-9a75-2a21392c7fd0', 'attached_at': '', 'detached_at': '', 'volume_id': '5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'serial': '5dcf2dad-f03a-4e7c-8e25-2317b7715d75'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:45:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:45:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:45:21 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:45:21 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:45:21 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca9f61-3f1d-448d-b755-0cf301234a57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:45:21 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fff727-4a20-4f74-9526-a5e5a8c6e656]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75] added
Apr 12 00:45:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ad03e-fc26-4ccf-841b-f8ddb512aa01]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3979c92-6bd4-4244-a828-72d177ebabbb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZeFvQrd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZeFvQrd" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc5461-3a1b-4159-a9b6-270b00d78f23]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZeFvQrd'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e367fa8-2737-4e10-90b6-ff18fbf2a0af]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2a30d9-9e2d-42ba-8bde-b55f95929e20]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4de7a6-9c70-413c-a9bb-8c19eb597ca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260]
Apr 12 00:45:22 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260] successful.
Apr 12 00:45:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f0175-0c57-4a28-88e1-20cca3654dfc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02325f3a-c17e-45c7-8b1b-59f8aa431baa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:45:22 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3004e96-5c63-45e6-8bd6-dfc026dd9d8a]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:45:22 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23733663937653566', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733663937653566', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944310669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944310669',id=36,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-xnsfofib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:45:12Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=b0c7ca20-c237-43b0-9a75-2a21392c7fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.objects.instance [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:45:23 user nova-compute[82394]:   <uuid>b0c7ca20-c237-43b0-9a75-2a21392c7fd0</uuid>
Apr 12 00:45:23 user nova-compute[82394]:   <name>instance-00000024</name>
Apr 12 00:45:23 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:45:23 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:45:23 user nova-compute[82394]:   <metadata>
Apr 12 00:45:23 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:45:23 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1944310669</nova:name>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:45:21</nova:creationTime>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:45:23 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:45:23 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:owner>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:45:23 user nova-compute[82394]:       </nova:owner>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:45:23 user nova-compute[82394]:       <nova:ports>
Apr 12 00:45:23 user nova-compute[82394]:         <nova:port uuid="2f72a2ec-42e3-4239-bf22-a5ecc61aedcf">
Apr 12 00:45:23 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 00:45:23 user nova-compute[82394]:         </nova:port>
Apr 12 00:45:23 user nova-compute[82394]:       </nova:ports>
Apr 12 00:45:23 user nova-compute[82394]:     </nova:instance>
Apr 12 00:45:23 user nova-compute[82394]:   </metadata>
Apr 12 00:45:23 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:45:23 user nova-compute[82394]:     <system>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="serial">b0c7ca20-c237-43b0-9a75-2a21392c7fd0</entry>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="uuid">b0c7ca20-c237-43b0-9a75-2a21392c7fd0</entry>
Apr 12 00:45:23 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:45:23 user nova-compute[82394]:     </system>
Apr 12 00:45:23 user nova-compute[82394]:   </sysinfo>
Apr 12 00:45:23 user nova-compute[82394]:   <os>
Apr 12 00:45:23 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:45:23 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:45:23 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:45:23 user nova-compute[82394]:   </os>
Apr 12 00:45:23 user nova-compute[82394]:   <features>
Apr 12 00:45:23 user nova-compute[82394]:     <acpi/>
Apr 12 00:45:23 user nova-compute[82394]:     <apic/>
Apr 12 00:45:23 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:45:23 user nova-compute[82394]:   </features>
Apr 12 00:45:23 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:45:23 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:45:23 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:45:23 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:45:23 user nova-compute[82394]:   </clock>
Apr 12 00:45:23 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:45:23 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:45:23 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:45:23 user nova-compute[82394]:   </cpu>
Apr 12 00:45:23 user nova-compute[82394]:   <devices>
Apr 12 00:45:23 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:45:23 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:45:23 user nova-compute[82394]:       <source dev="/dev/sde"/>
Apr 12 00:45:23 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:45:23 user nova-compute[82394]:       <serial>5dcf2dad-f03a-4e7c-8e25-2317b7715d75</serial>
Apr 12 00:45:23 user nova-compute[82394]:     </disk>
Apr 12 00:45:23 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:45:23 user nova-compute[82394]:       <mac address="fa:16:3e:66:e5:85"/>
Apr 12 00:45:23 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:45:23 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:45:23 user nova-compute[82394]:       <target dev="tap2f72a2ec-42"/>
Apr 12 00:45:23 user nova-compute[82394]:     </interface>
Apr 12 00:45:23 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:45:23 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/console.log" append="off"/>
Apr 12 00:45:23 user nova-compute[82394]:     </serial>
Apr 12 00:45:23 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:45:23 user nova-compute[82394]:     <video>
Apr 12 00:45:23 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:45:23 user nova-compute[82394]:     </video>
Apr 12 00:45:23 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:45:23 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:45:23 user nova-compute[82394]:     </rng>
Apr 12 00:45:23 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:45:23 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:45:23 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:45:23 user nova-compute[82394]:     </memballoon>
Apr 12 00:45:23 user nova-compute[82394]:   </devices>
Apr 12 00:45:23 user nova-compute[82394]: </domain>
Apr 12 00:45:23 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944310669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944310669',id=36,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-xnsfofib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:45:12Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=b0c7ca20-c237-43b0-9a75-2a21392c7fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG os_vif [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f72a2ec-42, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f72a2ec-42, col_values=(('external_ids', {'iface-id': '2f72a2ec-42e3-4239-bf22-a5ecc61aedcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:e5:85', 'vm-uuid': 'b0c7ca20-c237-43b0-9a75-2a21392c7fd0'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:23 user nova-compute[82394]: INFO os_vif [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42')
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:45:23 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:66:e5:85, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:45:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:25 user nova-compute[82394]: WARNING nova.compute.manager [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state building and task_state spawning.
Apr 12 00:45:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260327.019605, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Resumed (Lifecycle Event)
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance spawned successfully.
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260327.021058, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Started (Lifecycle Event)
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:27 user nova-compute[82394]: WARNING nova.compute.manager [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state building and task_state spawning.
Apr 12 00:45:27 user nova-compute[82394]: INFO nova.compute.manager [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Took 16.25 seconds to build instance.
Apr 12 00:45:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.350s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:34 user nova-compute[82394]: INFO nova.compute.manager [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Terminating instance
Apr 12 00:45:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-unplugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:45:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Instance destroyed successfully.
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'resources' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-4294683',display_name='tempest-TestMinimumBasicScenario-server-4294683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-4294683',id=28,image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw==',key_name='tempest-TestMinimumBasicScenario-1878126979',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-y60tdhp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2317fabf-b690-45f6-b138-d4e83ea7d334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:42:57Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=c57eddf0-bf85-4b87-a352-57508a728763,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "d1cda216-0dbb-4296-81c2-9386697372d2", "address": "fa:16:3e:5a:3e:c9", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cda216-0d", "ovs_interfaceid": "d1cda216-0dbb-4296-81c2-9386697372d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG os_vif [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cda216-0d, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:45:35 user nova-compute[82394]: INFO os_vif [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:3e:c9,bridge_name='br-int',has_traffic_filtering=True,id=d1cda216-0dbb-4296-81c2-9386697372d2,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cda216-0d')
Apr 12 00:45:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Deleting instance files /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763_del
Apr 12 00:45:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Deletion of /opt/stack/data/nova/instances/c57eddf0-bf85-4b87-a352-57508a728763_del complete
Apr 12 00:45:35 user nova-compute[82394]: INFO nova.compute.manager [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 00:45:35 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:45:35 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:36 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Took 0.61 seconds to deallocate network for instance.
Apr 12 00:45:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-deleted-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:45:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:36 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Deleted allocations for instance c57eddf0-bf85-4b87-a352-57508a728763
Apr 12 00:45:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "c57eddf0-bf85-4b87-a352-57508a728763" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Acquiring lock "c57eddf0-bf85-4b87-a352-57508a728763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Lock "c57eddf0-bf85-4b87-a352-57508a728763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] No waiting events found dispatching network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:37 user nova-compute[82394]: WARNING nova.compute.manager [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Received unexpected event network-vif-plugged-d1cda216-0dbb-4296-81c2-9386697372d2 for instance with vm_state deleted and task_state None.
Apr 12 00:45:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:46 user nova-compute[82394]: INFO nova.compute.manager [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Terminating instance
Apr 12 00:45:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-unplugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:45:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Instance destroyed successfully.
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1609902258',display_name='tempest-ServerRescueNegativeTestJSON-server-1609902258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1609902258',id=3,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-1zbegtx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:31:47Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=0334c8b1-3d0e-4af5-b86f-a6b41a3d6050,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "address": "fa:16:3e:de:53:f8", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb07b1c-aa", "ovs_interfaceid": "8cb07b1c-aa00-4fcf-983c-4b42566ef948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG os_vif [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb07b1c-aa, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:47 user nova-compute[82394]: INFO os_vif [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=8cb07b1c-aa00-4fcf-983c-4b42566ef948,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb07b1c-aa')
Apr 12 00:45:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Deleting instance files /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050_del
Apr 12 00:45:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Deletion of /opt/stack/data/nova/instances/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050_del complete
Apr 12 00:45:47 user nova-compute[82394]: INFO nova.compute.manager [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:47 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Took 0.45 seconds to deallocate network for instance.
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-deleted-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:48 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:45:48 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:45:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:48 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Deleted allocations for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050
Apr 12 00:45:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:48 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Acquiring lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Lock "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] No waiting events found dispatching network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:49 user nova-compute[82394]: WARNING nova.compute.manager [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Received unexpected event network-vif-plugged-8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance with vm_state deleted and task_state None.
Apr 12 00:45:50 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260335.5688903, c57eddf0-bf85-4b87-a352-57508a728763 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:45:50 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c57eddf0-bf85-4b87-a352-57508a728763] VM Stopped (Lifecycle Event)
Apr 12 00:45:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-bec754ad-d000-4037-bdb6-d4a87575e93f None None] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:45:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:45:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing instance network info cache due to event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Acquiring lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Acquired lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:45:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updated VIF entry in instance network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Releasing lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing instance network info cache due to event network-changed-6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Acquiring lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Acquired lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Refreshing network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:57 user nova-compute[82394]: INFO nova.compute.manager [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Terminating instance
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-unplugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] No waiting events found dispatching network-vif-unplugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-unplugged-6578df38-44dd-4f35-943f-b2da72deea5f for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updated VIF entry in instance network info cache for port 6578df38-44dd-4f35-943f-b2da72deea5f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [{"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Releasing lock "refresh_cache-e5d898c2-8548-4b32-829e-6afa11e1985f" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:45:58 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Instance destroyed successfully.
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.objects.instance [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid e5d898c2-8548-4b32-829e-6afa11e1985f {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2006086526',display_name='tempest-TestVolumeBootPattern-server-2006086526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2006086526',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-1l6oyngt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:44:15Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=e5d898c2-8548-4b32-829e-6afa11e1985f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "6578df38-44dd-4f35-943f-b2da72deea5f", "address": "fa:16:3e:e4:01:29", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6578df38-44", "ovs_interfaceid": "6578df38-44dd-4f35-943f-b2da72deea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_vif [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6578df38-44, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:45:58 user nova-compute[82394]: INFO os_vif [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:01:29,bridge_name='br-int',has_traffic_filtering=True,id=6578df38-44dd-4f35-943f-b2da72deea5f,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6578df38-44')
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSXhFgba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:45:58 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeba7eb-aaa4-426e-97e1-e6a2c027a933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:45:58 user nova-compute[82394]: No targets found.
Apr 12 00:45:58 user nova-compute[82394]: iSNS:
Apr 12 00:45:58 user nova-compute[82394]: No targets found.
Apr 12 00:45:58 user nova-compute[82394]: STATIC:
Apr 12 00:45:58 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:45:58 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:45:58 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:45:58 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62
Apr 12 00:45:58 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:45:58 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:45:58 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:45:58 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:45:58 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:45:58 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:45:58 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:45:58 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:45:58 user nova-compute[82394]: FIRMWARE:
Apr 12 00:45:58 user nova-compute[82394]: No targets found.
Apr 12 00:45:58 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:45:58 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:45:58 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3193045-ae84-4781-bbba-f92636f391d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad178707-5274-456f-b45f-d758b3a2ff35]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:45:58 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb234130550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64e00c-beda-41c1-8371-f34a26e0abf5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bee766-c123-4851-8c82-e3a65a0279e9]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c40023d-d11b-4954-a23f-3e7ffb07718c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6ac2b-0715-4860-a968-a8093897ec1f]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e906c52-5093-467a-a108-07abc35ff049]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[74721a7f-1ef5-4139-a5c7-fdb30a67c46b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260]
Apr 12 00:45:58 user nova-compute[82394]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62, portal: 172.16.0.220,3260] successful.
Apr 12 00:45:58 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d47a21-91ca-485b-8642-8e74639fdb62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[40527586-d3e0-4eb5-83ee-292e852c88ce]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (325ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:45:58 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Deleting instance files /opt/stack/data/nova/instances/e5d898c2-8548-4b32-829e-6afa11e1985f_del
Apr 12 00:45:58 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Deletion of /opt/stack/data/nova/instances/e5d898c2-8548-4b32-829e-6afa11e1985f_del complete
Apr 12 00:45:58 user nova-compute[82394]: INFO nova.compute.manager [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:58 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:59 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Took 1.05 seconds to deallocate network for instance.
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-deleted-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:59 user nova-compute[82394]: INFO nova.compute.manager [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Neutron deleted interface 6578df38-44dd-4f35-943f-b2da72deea5f; detaching it from the instance and deleting it from the info cache
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.network.neutron [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Detach interface failed, port_id=6578df38-44dd-4f35-943f-b2da72deea5f, reason: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Acquiring lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] No waiting events found dispatching network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:45:59 user nova-compute[82394]: WARNING nova.compute.manager [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Received unexpected event network-vif-plugged-6578df38-44dd-4f35-943f-b2da72deea5f for instance with vm_state active and task_state deleting.
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:45:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:00 user nova-compute[82394]: INFO nova.compute.manager [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Took 0.82 seconds to detach 1 volumes for instance.
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:46:00 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:00 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7931MB free_disk=26.268760681152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:46:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.850s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.390s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:01 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance e5d898c2-8548-4b32-829e-6afa11e1985f
Apr 12 00:46:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "e5d898c2-8548-4b32-829e-6afa11e1985f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.074s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 533174dc-5071-487b-9a2c-74cd7786af8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a346a131-2502-457a-acb8-8f903a7b87a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:46:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:02 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260347.2868268, 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:02 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] VM Stopped (Lifecycle Event)
Apr 12 00:46:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fd2da13c-f419-4d28-a6e1-477cd5a174fe None None] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:46:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:46:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:46:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:09 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:09 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing instance network info cache due to event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Acquiring lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Acquired lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:46:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updated VIF entry in instance network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:46:11 user nova-compute[82394]: DEBUG nova.network.neutron [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Releasing lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:13 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260358.084256, e5d898c2-8548-4b32-829e-6afa11e1985f => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:13 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] VM Stopped (Lifecycle Event)
Apr 12 00:46:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fd06b8b5-ce0a-4bc7-bdec-fc3f06180096 None None] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:14 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:46:14 user nova-compute[82394]: INFO nova.compute.claims [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Claim successful on node user
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:46:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:46:15 user nova-compute[82394]: INFO nova.virt.block_device [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Booting with volume cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 at /dev/vda
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.policy [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.utils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef3a5f-7169-41c6-8131-78c9401bee5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0298e6a-6e8f-4b00-8cdd-cb7afde6f420]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[44527f25-0d27-45ba-bc18-b87fe7e4a7e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e525c7-096f-4e5d-9395-746215c1062e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:46:15 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:46:15 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd52e20-0bb2-4d4e-a05c-8c5c1609672e]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG os_brick.utils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating existing volume attachment record: 7b88b73b-1766-4c1b-8a6a-79f723c4fb67 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Successfully created port: 6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Successfully updated port: 6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-changed-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Refreshing instance network info cache due to event network-changed-6014f3cd-13ce-4fba-9cba-057192db2b3d. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:46:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance network_info: |[{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Refreshing network info cache for port 6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updated VIF entry in instance network info cache for port 6014f3cd-13ce-4fba-9cba-057192db2b3d. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-changed-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Refreshing instance network info cache due to event network-changed-9457e7d7-925c-4488-bb2d-c3019a663c42. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Acquiring lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Acquired lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Refreshing network info cache for port 9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updated VIF entry in instance network info cache for port 9457e7d7-925c-4488-bb2d-c3019a663c42. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.network.neutron [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updating instance_info_cache with network_info: [{"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Releasing lock "refresh_cache-a346a131-2502-457a-acb8-8f903a7b87a7" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:46:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Creating image(s)
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start _get_guest_xml network_info=[{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7b88b73b-1766-4c1b-8a6a-79f723c4fb67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'serial': 'cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:46:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:19 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea9947-3f95-451d-acc8-3919f778178d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:46:19 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280178d-4efe-435a-833c-b2dd7577fd09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7] added
Apr 12 00:46:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5838509-f163-478d-b4bc-8acc09b72ac2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d677c97-1835-46d5-87af-5d20f51221d8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLYFINPy {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLYFINPy" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f53f66-a6bf-47dc-a14c-b0a3886cca3e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLYFINPy'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b33e5c-18a0-4618-b4ba-3fe3eff35c72]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b6b23c-81cf-4f93-8e0b-14bcfcad2451]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b693f-4361-4ae5-aacd-1b65cfc6aa4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]
Apr 12 00:46:20 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.
Apr 12 00:46:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429ba84-ca82-45a2-aaf0-b3c33d9e377a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558e90a-4256-46b0-9332-bc8f3b4327d7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc3d09-7e20-44ec-96b1-1674dc7d150f]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:20 user nova-compute[82394]: INFO nova.compute.manager [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Attaching volume e372d117-4889-4cbc-8b8c-f8955dcea7be to /dev/vdb
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.utils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df7bca-087f-4c18-ad31-0850e65dcbec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d5cbb9-7292-4558-b4e0-754b2cc8c5ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e4299e-c9c8-4381-8fe1-7edd30e310db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2d9fd-7ed2-40b4-95ab-fd764d1b4c99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:46:20 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:46:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f794941-e5b6-4137-8da0-5c4966ef9794]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG os_brick.utils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:20 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updating existing volume attachment record: a9e20226-985e-4da4-93ff-dd829460a9bc {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23765346633623831', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765346633623831', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:46:21 user nova-compute[82394]:   <uuid>c7f4b0ac-f740-46b5-99f1-4129cccf1749</uuid>
Apr 12 00:46:21 user nova-compute[82394]:   <name>instance-00000025</name>
Apr 12 00:46:21 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:46:21 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:46:21 user nova-compute[82394]:   <metadata>
Apr 12 00:46:21 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:46:21 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:46:21 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-1379829063</nova:name>
Apr 12 00:46:21 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:46:19</nova:creationTime>
Apr 12 00:46:21 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:46:21 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:46:21 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:46:21 user nova-compute[82394]:       <nova:owner>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:46:21 user nova-compute[82394]:       </nova:owner>
Apr 12 00:46:21 user nova-compute[82394]:       <nova:ports>
Apr 12 00:46:21 user nova-compute[82394]:         <nova:port uuid="6014f3cd-13ce-4fba-9cba-057192db2b3d">
Apr 12 00:46:21 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 00:46:21 user nova-compute[82394]:         </nova:port>
Apr 12 00:46:21 user nova-compute[82394]:       </nova:ports>
Apr 12 00:46:21 user nova-compute[82394]:     </nova:instance>
Apr 12 00:46:21 user nova-compute[82394]:   </metadata>
Apr 12 00:46:21 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:46:21 user nova-compute[82394]:     <system>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="serial">c7f4b0ac-f740-46b5-99f1-4129cccf1749</entry>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="uuid">c7f4b0ac-f740-46b5-99f1-4129cccf1749</entry>
Apr 12 00:46:21 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:46:21 user nova-compute[82394]:     </system>
Apr 12 00:46:21 user nova-compute[82394]:   </sysinfo>
Apr 12 00:46:21 user nova-compute[82394]:   <os>
Apr 12 00:46:21 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:46:21 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:46:21 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:46:21 user nova-compute[82394]:   </os>
Apr 12 00:46:21 user nova-compute[82394]:   <features>
Apr 12 00:46:21 user nova-compute[82394]:     <acpi/>
Apr 12 00:46:21 user nova-compute[82394]:     <apic/>
Apr 12 00:46:21 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:46:21 user nova-compute[82394]:   </features>
Apr 12 00:46:21 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:46:21 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:46:21 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:46:21 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:46:21 user nova-compute[82394]:   </clock>
Apr 12 00:46:21 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:46:21 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:46:21 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:46:21 user nova-compute[82394]:   </cpu>
Apr 12 00:46:21 user nova-compute[82394]:   <devices>
Apr 12 00:46:21 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:46:21 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:46:21 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:46:21 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:46:21 user nova-compute[82394]:       <serial>cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7</serial>
Apr 12 00:46:21 user nova-compute[82394]:     </disk>
Apr 12 00:46:21 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:46:21 user nova-compute[82394]:       <mac address="fa:16:3e:ee:a0:1e"/>
Apr 12 00:46:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:46:21 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:46:21 user nova-compute[82394]:       <target dev="tap6014f3cd-13"/>
Apr 12 00:46:21 user nova-compute[82394]:     </interface>
Apr 12 00:46:21 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:46:21 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749/console.log" append="off"/>
Apr 12 00:46:21 user nova-compute[82394]:     </serial>
Apr 12 00:46:21 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:46:21 user nova-compute[82394]:     <video>
Apr 12 00:46:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:46:21 user nova-compute[82394]:     </video>
Apr 12 00:46:21 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:46:21 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:46:21 user nova-compute[82394]:     </rng>
Apr 12 00:46:21 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:46:21 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:46:21 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:46:21 user nova-compute[82394]:     </memballoon>
Apr 12 00:46:21 user nova-compute[82394]:   </devices>
Apr 12 00:46:21 user nova-compute[82394]: </domain>
Apr 12 00:46:21 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG os_vif [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6014f3cd-13, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6014f3cd-13, col_values=(('external_ids', {'iface-id': '6014f3cd-13ce-4fba-9cba-057192db2b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:a0:1e', 'vm-uuid': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:21 user nova-compute[82394]: INFO os_vif [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13')
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:46:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:ee:a0:1e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:22 user nova-compute[82394]: WARNING nova.compute.manager [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state building and task_state spawning.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260385.0423503, c7f4b0ac-f740-46b5-99f1-4129cccf1749 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] VM Resumed (Lifecycle Event)
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance spawned successfully.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:25 user nova-compute[82394]: WARNING nova.compute.manager [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state building and task_state spawning.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260385.045454, c7f4b0ac-f740-46b5-99f1-4129cccf1749 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] VM Started (Lifecycle Event)
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:46:25 user nova-compute[82394]: INFO nova.compute.manager [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Took 10.64 seconds to build instance.
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.731s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUSfwjRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:25 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:25 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:25 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ebe5f0-0c28-485d-b467-5b676f958e49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:46:25 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dbb9d7-e670-4960-9722-2fe15e507050]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be] added
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4742c-1261-43c7-96cf-019831336dc1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d6629-0d4e-470c-b5ff-d3d89926dbc5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUSfwjRD {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUSfwjRD" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9153913-71ed-4705-b927-af375dc660ae]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUSfwjRD'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcf43f-f327-448d-980a-e905f094608d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6624d7ff-f51a-4c86-8360-49444d1e9fd5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[76119355-70b7-45f5-b441-9ab486648ea2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260]
Apr 12 00:46:25 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260] successful.
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9755533f-1982-455b-a965-3e9693e17292]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[91734bb5-0557-4224-930a-74d90aa8b4f0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:25 user nova-compute[82394]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)
Apr 12 00:46:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf783c-073f-4fce-8e7c-7e370e96fe40]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:46:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUSfwjRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23964366435643663', 'path': '/dev/sdf'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964366435643663', 'path': '/dev/sdf'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:46:26 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:46:26 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:46:26 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:46:26 user nova-compute[82394]:   <serial>e372d117-4889-4cbc-8b8c-f8955dcea7be</serial>
Apr 12 00:46:26 user nova-compute[82394]: </disk>
Apr 12 00:46:26 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:46:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:46:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:46:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] No VIF found with MAC fa:16:3e:a6:b6:43, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:46:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.630s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:28 user nova-compute[82394]: INFO nova.compute.manager [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Detaching volume e372d117-4889-4cbc-8b8c-f8955dcea7be
Apr 12 00:46:28 user nova-compute[82394]: INFO nova.virt.block_device [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Attempting to driver detach volume e372d117-4889-4cbc-8b8c-f8955dcea7be from mountpoint /dev/vdb
Apr 12 00:46:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Attempting to detach device vdb from instance a346a131-2502-457a-acb8-8f903a7b87a7 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:46:28 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:46:28 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:46:28 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:46:28 user nova-compute[82394]:   <serial>e372d117-4889-4cbc-8b8c-f8955dcea7be</serial>
Apr 12 00:46:28 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:46:28 user nova-compute[82394]: </disk>
Apr 12 00:46:28 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:46:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance a346a131-2502-457a-acb8-8f903a7b87a7 from the persistent domain config.
Apr 12 00:46:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a346a131-2502-457a-acb8-8f903a7b87a7 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:46:28 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:46:28 user nova-compute[82394]:   <source dev="/dev/sdf"/>
Apr 12 00:46:28 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:46:28 user nova-compute[82394]:   <serial>e372d117-4889-4cbc-8b8c-f8955dcea7be</serial>
Apr 12 00:46:28 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:46:28 user nova-compute[82394]: </disk>
Apr 12 00:46:28 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:46:29 user nova-compute[82394]: INFO nova.compute.claims [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Claim successful on node user
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260389.4163713, a346a131-2502-457a-acb8-8f903a7b87a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:46:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully detached device vdb from instance a346a131-2502-457a-acb8-8f903a7b87a7 from the live domain config.
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUSfwjRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:29 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93153e-6fa4-4617-85ac-c0e53a1749f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:46:29 user nova-compute[82394]: No targets found.
Apr 12 00:46:29 user nova-compute[82394]: iSNS:
Apr 12 00:46:29 user nova-compute[82394]: No targets found.
Apr 12 00:46:29 user nova-compute[82394]: STATIC:
Apr 12 00:46:29 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:46:29 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:29 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:29 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:46:29 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:29 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:29 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:46:29 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:29 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:29 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:46:29 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:29 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:29 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be
Apr 12 00:46:29 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:29 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:29 user nova-compute[82394]: FIRMWARE:
Apr 12 00:46:29 user nova-compute[82394]: No targets found.
Apr 12 00:46:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:46:29 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:46:29 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b98584-dc27-4ee1-991b-55d63acaafcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b64b139-7ade-4ce5-a888-a58da4e06a90]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)
Apr 12 00:46:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:29 user nova-compute[82394]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be (non-flash)
Apr 12 00:46:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0f97250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be'): ({'sdf'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Removing single pathed devices sdf {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a06514-d621-40f1-89be-64ff72e5e4a0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6c4fab-057b-40a2-a400-65f941b6257e]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flushing IO for device /dev/sdf {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae5980-e1f2-478f-8d49-7e3f8d682cef]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce16e0-125a-4cc9-bc65-e8300eb26b53]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] SCSI volumes sdf have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d003c2a-f990-46f7-91e3-d373ded7054d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.policy [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[658fe595-7a2b-4bdc-b3b6-c923fb0858b4]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260]
Apr 12 00:46:29 user nova-compute[82394]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be, portal: 172.16.0.220,3260] successful.
Apr 12 00:46:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:46:29 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Creating image(s)
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "/opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "/opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e372d117-4889-4cbc-8b8c-f8955dcea7be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8eb7a7-49fc-4cc3-9528-23c5c672ab5d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] <== disconnect_volume: return (345ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.part --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG nova.virt.images [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 31461e92-139a-4213-a81b-97f686de3b0e was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.part /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.part /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.converted" returned: 0 in 0.198s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Successfully created port: b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.872s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json" returned: 0 in 0.162s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2,backing_fmt=raw /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'flavor' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2,backing_fmt=raw /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk 1073741824" returned: 0 in 0.057s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "4aa2b1159115a45557aa420a9573fa5d14424bc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:30 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.240s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Cannot resize image /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'migration_context' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Ensure instance console log exists: /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Successfully updated port: b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing instance network info cache due to event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance network_info: |[{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Start _get_guest_xml network_info=[{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:46:26Z,direct_url=<?>,disk_format='qcow2',id=31461e92-139a-4213-a81b-97f686de3b0e,min_disk=0,min_ram=0,name='tempest-scenario-img--1921924608',owner='e66fda80cb83402392e155c76ee78e1f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:46:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '31461e92-139a-4213-a81b-97f686de3b0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:46:31 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:31 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:46:26Z,direct_url=<?>,disk_format='qcow2',id=31461e92-139a-4213-a81b-97f686de3b0e,min_disk=0,min_ram=0,name='tempest-scenario-img--1921924608',owner='e66fda80cb83402392e155c76ee78e1f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:46:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381148789',display_name='tempest-TestMinimumBasicScenario-server-381148789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381148789',id=38,image_ref='31461e92-139a-4213-a81b-97f686de3b0e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKUjMUHJg1ZJrVvMP4uF5S0HHA87ZxyaAz9hfCYZiiiib71m38Sm7mvxr0QpYkB8Gavhzox7dRsXgcBgTh+Oh0K1TRPHl0cUmphSvbOmnIOmcwihIPv00AoperWHPnpYQ==',key_name='tempest-TestMinimumBasicScenario-609117724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-r15tteuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31461e92-139a-4213-a81b-97f686de3b0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:46:30Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=1fdb2b97-85b9-4e15-b586-948c3804da90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:46:31 user nova-compute[82394]:   <uuid>1fdb2b97-85b9-4e15-b586-948c3804da90</uuid>
Apr 12 00:46:31 user nova-compute[82394]:   <name>instance-00000026</name>
Apr 12 00:46:31 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:46:31 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:46:31 user nova-compute[82394]:   <metadata>
Apr 12 00:46:31 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:46:31 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:name>tempest-TestMinimumBasicScenario-server-381148789</nova:name>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:46:31</nova:creationTime>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:46:31 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:46:31 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:owner>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:user uuid="2842535891eb4a9880f7e8859dd0de3c">tempest-TestMinimumBasicScenario-1682364358-project-member</nova:user>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:project uuid="e66fda80cb83402392e155c76ee78e1f">tempest-TestMinimumBasicScenario-1682364358</nova:project>
Apr 12 00:46:31 user nova-compute[82394]:       </nova:owner>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:root type="image" uuid="31461e92-139a-4213-a81b-97f686de3b0e"/>
Apr 12 00:46:31 user nova-compute[82394]:       <nova:ports>
Apr 12 00:46:31 user nova-compute[82394]:         <nova:port uuid="b145d6f4-4a6d-4ab7-9797-6a0b15f165e7">
Apr 12 00:46:31 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 00:46:31 user nova-compute[82394]:         </nova:port>
Apr 12 00:46:31 user nova-compute[82394]:       </nova:ports>
Apr 12 00:46:31 user nova-compute[82394]:     </nova:instance>
Apr 12 00:46:31 user nova-compute[82394]:   </metadata>
Apr 12 00:46:31 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:46:31 user nova-compute[82394]:     <system>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="serial">1fdb2b97-85b9-4e15-b586-948c3804da90</entry>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="uuid">1fdb2b97-85b9-4e15-b586-948c3804da90</entry>
Apr 12 00:46:31 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:46:31 user nova-compute[82394]:     </system>
Apr 12 00:46:31 user nova-compute[82394]:   </sysinfo>
Apr 12 00:46:31 user nova-compute[82394]:   <os>
Apr 12 00:46:31 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:46:31 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:46:31 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:46:31 user nova-compute[82394]:   </os>
Apr 12 00:46:31 user nova-compute[82394]:   <features>
Apr 12 00:46:31 user nova-compute[82394]:     <acpi/>
Apr 12 00:46:31 user nova-compute[82394]:     <apic/>
Apr 12 00:46:31 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:46:31 user nova-compute[82394]:   </features>
Apr 12 00:46:31 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:46:31 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:46:31 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:46:31 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:46:31 user nova-compute[82394]:   </clock>
Apr 12 00:46:31 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:46:31 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:46:31 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:46:31 user nova-compute[82394]:   </cpu>
Apr 12 00:46:31 user nova-compute[82394]:   <devices>
Apr 12 00:46:31 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:46:31 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:46:31 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk"/>
Apr 12 00:46:31 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:46:31 user nova-compute[82394]:     </disk>
Apr 12 00:46:31 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:46:31 user nova-compute[82394]:       <mac address="fa:16:3e:69:48:2b"/>
Apr 12 00:46:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:46:31 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:46:31 user nova-compute[82394]:       <target dev="tapb145d6f4-4a"/>
Apr 12 00:46:31 user nova-compute[82394]:     </interface>
Apr 12 00:46:31 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:46:31 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/console.log" append="off"/>
Apr 12 00:46:31 user nova-compute[82394]:     </serial>
Apr 12 00:46:31 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:46:31 user nova-compute[82394]:     <video>
Apr 12 00:46:31 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:46:31 user nova-compute[82394]:     </video>
Apr 12 00:46:31 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:46:31 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:46:31 user nova-compute[82394]:     </rng>
Apr 12 00:46:31 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:46:31 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:46:31 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:46:31 user nova-compute[82394]:     </memballoon>
Apr 12 00:46:31 user nova-compute[82394]:   </devices>
Apr 12 00:46:31 user nova-compute[82394]: </domain>
Apr 12 00:46:31 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381148789',display_name='tempest-TestMinimumBasicScenario-server-381148789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381148789',id=38,image_ref='31461e92-139a-4213-a81b-97f686de3b0e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKUjMUHJg1ZJrVvMP4uF5S0HHA87ZxyaAz9hfCYZiiiib71m38Sm7mvxr0QpYkB8Gavhzox7dRsXgcBgTh+Oh0K1TRPHl0cUmphSvbOmnIOmcwihIPv00AoperWHPnpYQ==',key_name='tempest-TestMinimumBasicScenario-609117724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-r15tteuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31461e92-139a-4213-a81b-97f686de3b0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:46:30Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=1fdb2b97-85b9-4e15-b586-948c3804da90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG os_vif [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb145d6f4-4a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb145d6f4-4a, col_values=(('external_ids', {'iface-id': 'b145d6f4-4a6d-4ab7-9797-6a0b15f165e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:48:2b', 'vm-uuid': '1fdb2b97-85b9-4e15-b586-948c3804da90'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:31 user nova-compute[82394]: INFO os_vif [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a')
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:46:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No VIF found with MAC fa:16:3e:69:48:2b, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:46:32 user nova-compute[82394]: DEBUG nova.network.neutron [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updated VIF entry in instance network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:46:32 user nova-compute[82394]: DEBUG nova.network.neutron [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:33 user nova-compute[82394]: WARNING nova.compute.manager [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state building and task_state spawning.
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260395.2843924, 1fdb2b97-85b9-4e15-b586-948c3804da90 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] VM Resumed (Lifecycle Event)
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance spawned successfully.
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260395.2876594, 1fdb2b97-85b9-4e15-b586-948c3804da90 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] VM Started (Lifecycle Event)
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:35 user nova-compute[82394]: INFO nova.compute.manager [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Took 6.41 seconds to build instance.
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:35 user nova-compute[82394]: WARNING nova.compute.manager [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state active and task_state None.
Apr 12 00:46:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:37 user nova-compute[82394]: INFO nova.compute.manager [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Terminating instance
Apr 12 00:46:37 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-unplugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Instance destroyed successfully.
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'resources' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-254044738',display_name='tempest-ServerRescueNegativeTestJSON-server-254044738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-254044738',id=2,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcf1fea74ef143e6b394e41e7c4ed495',ramdisk_id='',reservation_id='r-0lxmmwfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1300870234',owner_user_name='tempest-ServerRescueNegativeTestJSON-1300870234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:36:30Z,user_data=None,user_id='6b9421443b2f421298a934122c6a8b8c',uuid=8d895d64-319f-4c67-8c20-ef0d0437a1f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converting VIF {"id": "e92d06cb-6535-4389-b328-57add5f4f812", "address": "fa:16:3e:ac:e7:ce", "network": {"id": "2672ea92-a779-4d3e-8b39-13317b97c3a7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1266070637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcf1fea74ef143e6b394e41e7c4ed495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92d06cb-65", "ovs_interfaceid": "e92d06cb-6535-4389-b328-57add5f4f812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG os_vif [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape92d06cb-65, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:46:38 user nova-compute[82394]: INFO os_vif [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e7:ce,bridge_name='br-int',has_traffic_filtering=True,id=e92d06cb-6535-4389-b328-57add5f4f812,network=Network(2672ea92-a779-4d3e-8b39-13317b97c3a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92d06cb-65')
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Deleting instance files /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0_del
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Deletion of /opt/stack/data/nova/instances/8d895d64-319f-4c67-8c20-ef0d0437a1f0_del complete
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.compute.manager [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 00:46:38 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Took 0.53 seconds to deallocate network for instance.
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-deleted-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:38 user nova-compute[82394]: INFO nova.compute.manager [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Neutron deleted interface e92d06cb-6535-4389-b328-57add5f4f812; detaching it from the instance and deleting it from the info cache
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.network.neutron [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Detach interface failed, port_id=e92d06cb-6535-4389-b328-57add5f4f812, reason: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:39 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Deleted allocations for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0
Apr 12 00:46:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Acquiring lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Lock "8d895d64-319f-4c67-8c20-ef0d0437a1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] No waiting events found dispatching network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:39 user nova-compute[82394]: WARNING nova.compute.manager [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Received unexpected event network-vif-plugged-e92d06cb-6535-4389-b328-57add5f4f812 for instance with vm_state deleted and task_state None.
Apr 12 00:46:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing instance network info cache due to event network-changed-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Acquiring lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Acquired lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Refreshing network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:50 user nova-compute[82394]: INFO nova.compute.manager [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Terminating instance
Apr 12 00:46:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Instance destroyed successfully.
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lazy-loading 'resources' on Instance uuid 533174dc-5071-487b-9a2c-74cd7786af8a {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790407973',display_name='tempest-TestVolumeBootPattern-server-1790407973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1790407973',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ==',key_name='tempest-TestVolumeBootPattern-1592613584',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38a98bf1d964ee6bd2d0d05e97a283a',ramdisk_id='',reservation_id='r-xr9ouv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-726466832',owner_user_name='tempest-TestVolumeBootPattern-726466832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:42:20Z,user_data=None,user_id='c479f6ae2f0d40908be9b07717ca3509',uuid=533174dc-5071-487b-9a2c-74cd7786af8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converting VIF {"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_vif [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd983e69a-5d, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:46:51 user nova-compute[82394]: INFO os_vif [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30,network=Network(159bca51-de37-4d87-9af5-ec97816a869c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983e69a-5d')
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVRDsQTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:46:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bde4f0-1812-45ae-8020-3a7d042765e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:46:51 user nova-compute[82394]: No targets found.
Apr 12 00:46:51 user nova-compute[82394]: iSNS:
Apr 12 00:46:51 user nova-compute[82394]: No targets found.
Apr 12 00:46:51 user nova-compute[82394]: STATIC:
Apr 12 00:46:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:46:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:46:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda
Apr 12 00:46:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:51 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:46:51 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:46:51 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:46:51 user nova-compute[82394]: FIRMWARE:
Apr 12 00:46:51 user nova-compute[82394]: No targets found.
Apr 12 00:46:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:46:51 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:46:51 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[647b91a8-35c0-49ac-9b41-746ffcfb3f54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc2651-274a-41e4-b702-af4d07cea085]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:46:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0ebd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346f94d-2bff-49d8-9bcc-476bf8bbc0a8]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957d4e3-904b-42df-a566-460a306d627f]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9cd9a-28c5-49a9-bd07-6839ef01eec2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0df6891-942c-4239-b246-af05538d14d4]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23633653462336332', '/dev/disk/by-id/scsi-1SCST_BIOb701845c-63e4b3c2c5161ae7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b701845c') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:46:51 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23633653462336332
Apr 12 00:46:51 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb701845c-63e4b3c2c5161ae7
Apr 12 00:46:51 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b701845c
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a94f5-3ee5-4156-9538-7208b6ae8600]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[751772bb-3095-4ed7-ae0a-5fd1c6b03479]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8689e2-9853-4e16-a5d6-88eea2c82aff]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260]
Apr 12 00:46:51 user nova-compute[82394]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda, portal: 172.16.0.220,3260] successful.
Apr 12 00:46:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updated VIF entry in instance network info cache for port d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating instance_info_cache with network_info: [{"id": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "address": "fa:16:3e:ad:7d:6f", "network": {"id": "159bca51-de37-4d87-9af5-ec97816a869c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726102582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38a98bf1d964ee6bd2d0d05e97a283a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983e69a-5d", "ovs_interfaceid": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39255a99-7938-4a08-af09-fe2d718c4fda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d7d316-cf90-4f7c-aecc-78666d364ecb]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] <== disconnect_volume: return (394ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:46:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Deleting instance files /opt/stack/data/nova/instances/533174dc-5071-487b-9a2c-74cd7786af8a_del
Apr 12 00:46:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Deletion of /opt/stack/data/nova/instances/533174dc-5071-487b-9a2c-74cd7786af8a_del complete
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Releasing lock "refresh_cache-533174dc-5071-487b-9a2c-74cd7786af8a" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:46:51 user nova-compute[82394]: INFO nova.compute.manager [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 12 00:46:51 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:46:51 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:46:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Took 0.46 seconds to deallocate network for instance.
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-deleted-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-unplugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] No waiting events found dispatching network-vif-unplugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-unplugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Acquiring lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "533174dc-5071-487b-9a2c-74cd7786af8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] No waiting events found dispatching network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:46:52 user nova-compute[82394]: WARNING nova.compute.manager [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Received unexpected event network-vif-plugged-d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance with vm_state active and task_state deleting.
Apr 12 00:46:52 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260397.9971259, 8d895d64-319f-4c67-8c20-ef0d0437a1f0 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:46:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] VM Stopped (Lifecycle Event)
Apr 12 00:46:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2a2c3a6f-abd4-4764-8ee1-c501fa69c1cd None None] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:46:53 user nova-compute[82394]: INFO nova.compute.manager [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Took 0.75 seconds to detach 1 volumes for instance.
Apr 12 00:46:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:53 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:46:53 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:46:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:53 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Deleted allocations for instance 533174dc-5071-487b-9a2c-74cd7786af8a
Apr 12 00:46:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "533174dc-5071-487b-9a2c-74cd7786af8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:46:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 77f09d77-815b-4e7c-905d-b27ae017c9d5 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 84861eef-6d59-448b-b6b7-eb8dd8e47b30 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:46:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:46:58 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:46:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:00 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:00 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:00 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=26.248641967773438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a346a131-2502-457a-acb8-8f903a7b87a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:01 user nova-compute[82394]: INFO nova.compute.manager [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Rescuing
Apr 12 00:47:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:47:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating instance_info_cache with network_info: [{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:02 user nova-compute[82394]: WARNING nova.compute.manager [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state rescuing.
Apr 12 00:47:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:47:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance destroyed successfully.
Apr 12 00:47:02 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Attempting a stable device rescue
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:47:03 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Creating image(s)
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.part --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.virt.images [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 00c5aeee-0f41-4c27-99f4-e43510084de0 was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.part /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.part /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.converted" returned: 0 in 0.230s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.246s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:04 user nova-compute[82394]: WARNING nova.compute.manager [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state rescuing.
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c,backing_fmt=raw /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c,backing_fmt=raw /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "8d5559ececf8a3f4b186a1aee5f17015ccb2449c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'migration_context' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start _get_guest_xml network_info=[{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:66:e5:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '00c5aeee-0f41-4c27-99f4-e43510084de0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77f028a0-edbf-41dc-a086-e62244db6b47', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b0c7ca20-c237-43b0-9a75-2a21392c7fd0', 'attached_at': '', 'detached_at': '', 'volume_id': '5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'serial': '5dcf2dad-f03a-4e7c-8e25-2317b7715d75'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'numa_topology' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:47:04 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:47:04 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:47:04 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a2244-f226-462d-884d-22fee81d8257]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xZeFvQrd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 00:47:04 user nova-compute[82394]: node.name = iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:47:04 user nova-compute[82394]: node.tpgt = -1
Apr 12 00:47:04 user nova-compute[82394]: node.startup = automatic
Apr 12 00:47:04 user nova-compute[82394]: node.leading_login = No
Apr 12 00:47:04 user nova-compute[82394]: iface.iscsi_ifacename = default
Apr 12 00:47:04 user nova-compute[82394]: iface.net_ifacename = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.ipaddress = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.prefix_len = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.hwaddress = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.transport_name = tcp
Apr 12 00:47:04 user nova-compute[82394]: iface.initiatorname = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.vlan_id = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.vlan_priority = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.vlan_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.iface_num = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.mtu = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.port = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.bootproto = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.subnet_mask = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.gateway = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_alt_client_id = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_dns = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_learn_iqn = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_vendor_id_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_vendor_id = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.dhcp_slp_da = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.fragmentation = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.gratuitous_arp = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.incoming_forwarding = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.tos_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.tos = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.ttl = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.delayed_ack = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.tcp_nagle = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.tcp_wsf_state = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.tcp_wsf = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.tcp_timer_scale = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.tcp_timestamp = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.redirect = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.def_task_mgmt_timeout = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.header_digest = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.data_digest = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.immediate_data = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.initial_r2t = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.data_seq_inorder = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.data_pdu_inorder = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.erl = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.max_receive_data_len = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.first_burst_len = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.max_outstanding_r2t = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.max_burst_len = 0
Apr 12 00:47:04 user nova-compute[82394]: iface.chap_auth = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.bidi_chap = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.strict_login_compliance = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.discovery_auth = <empty>
Apr 12 00:47:04 user nova-compute[82394]: iface.discovery_logout = <empty>
Apr 12 00:47:04 user nova-compute[82394]: node.discovery_address = <empty>
Apr 12 00:47:04 user nova-compute[82394]: node.discovery_port = 0
Apr 12 00:47:04 user nova-compute[82394]: node.discovery_type = static
Apr 12 00:47:04 user nova-compute[82394]: node.session.initial_cmdsn = 0
Apr 12 00:47:04 user nova-compute[82394]: node.session.initial_login_retry_max = 8
Apr 12 00:47:04 user nova-compute[82394]: node.session.xmit_thread_priority = -20
Apr 12 00:47:04 user nova-compute[82394]: node.session.cmds_max = 128
Apr 12 00:47:04 user nova-compute[82394]: node.session.queue_depth = 32
Apr 12 00:47:04 user nova-compute[82394]: node.session.nr_sessions = 1
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.authmethod = CHAP
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.username = xZeFvQrd
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.password = ***
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.username_in = <empty>
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.password_in = <empty>
Apr 12 00:47:04 user nova-compute[82394]: node.session.auth.chap_algs = MD5
Apr 12 00:47:04 user nova-compute[82394]: node.session.timeo.replacement_timeout = 120
Apr 12 00:47:04 user nova-compute[82394]: node.session.err_timeo.abort_timeout = 15
Apr 12 00:47:04 user nova-compute[82394]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 00:47:04 user nova-compute[82394]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 00:47:04 user nova-compute[82394]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.FastAbort = Yes
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.InitialR2T = No
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.ImmediateData = Yes
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.MaxConnections = 1
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 00:47:04 user nova-compute[82394]: node.session.iscsi.ERL = 0
Apr 12 00:47:04 user nova-compute[82394]: node.session.scan = manual
Apr 12 00:47:04 user nova-compute[82394]: node.session.reopen_max = 0
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].address = 172.16.0.220
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].port = 3260
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].startup = manual
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].tcp.window_size = 524288
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].tcp.type_of_service = 0
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].timeo.logout_timeout = 15
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].timeo.login_timeout = 15
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].timeo.auth_timeout = 45
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.DataDigest = None
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.IFMarker = No
Apr 12 00:47:04 user nova-compute[82394]: node.conn[0].iscsi.OFMarker = No
Apr 12 00:47:04 user nova-compute[82394]: # END RECORD
Apr 12 00:47:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfea2ea-1306-40f5-b5fc-bb2b40cf09dd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8d1e2-3a82-4a74-ae12-87f96c98864a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZeFvQrd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZeFvQrd" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2ca96-7c71-4f6a-aaab-defd11a2de5d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZeFvQrd'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bd088-088b-4c84-bec7-cc697bc5b41b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9676711-e678-4dc6-844a-c6433c5b9ee6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:47:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HCTL ('36', '0', '0', 0) found on session 40 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c050c-2a88-48af-ab19-320c6bf3d4d8]: (4, ('0 0 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Searching for a device in session 40 and hctl ('36', '0', '0', 0) yield: sde {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23733663937653566', 'path': '/dev/sde'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733663937653566', 'path': '/dev/sde'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944310669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944310669',id=36,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-xnsfofib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:45:27Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=b0c7ca20-c237-43b0-9a75-2a21392c7fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:66:e5:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "vif_mac": "fa:16:3e:66:e5:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:47:04 user nova-compute[82394]:   <uuid>b0c7ca20-c237-43b0-9a75-2a21392c7fd0</uuid>
Apr 12 00:47:04 user nova-compute[82394]:   <name>instance-00000024</name>
Apr 12 00:47:04 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:47:04 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:47:04 user nova-compute[82394]:   <metadata>
Apr 12 00:47:04 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:47:04 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1944310669</nova:name>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:47:04</nova:creationTime>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:47:04 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:47:04 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:owner>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:user uuid="69d6e340820641729772cf35648ef785">tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member</nova:user>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:project uuid="f4a7eb4a2a09418eacdeaccefbf7de15">tempest-ServerBootFromVolumeStableRescueTest-410532057</nova:project>
Apr 12 00:47:04 user nova-compute[82394]:       </nova:owner>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:47:04 user nova-compute[82394]:       <nova:ports>
Apr 12 00:47:04 user nova-compute[82394]:         <nova:port uuid="2f72a2ec-42e3-4239-bf22-a5ecc61aedcf">
Apr 12 00:47:04 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 00:47:04 user nova-compute[82394]:         </nova:port>
Apr 12 00:47:04 user nova-compute[82394]:       </nova:ports>
Apr 12 00:47:04 user nova-compute[82394]:     </nova:instance>
Apr 12 00:47:04 user nova-compute[82394]:   </metadata>
Apr 12 00:47:04 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:47:04 user nova-compute[82394]:     <system>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="serial">b0c7ca20-c237-43b0-9a75-2a21392c7fd0</entry>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="uuid">b0c7ca20-c237-43b0-9a75-2a21392c7fd0</entry>
Apr 12 00:47:04 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:47:04 user nova-compute[82394]:     </system>
Apr 12 00:47:04 user nova-compute[82394]:   </sysinfo>
Apr 12 00:47:04 user nova-compute[82394]:   <os>
Apr 12 00:47:04 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:47:04 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:47:04 user nova-compute[82394]:   </os>
Apr 12 00:47:04 user nova-compute[82394]:   <features>
Apr 12 00:47:04 user nova-compute[82394]:     <acpi/>
Apr 12 00:47:04 user nova-compute[82394]:     <apic/>
Apr 12 00:47:04 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:47:04 user nova-compute[82394]:   </features>
Apr 12 00:47:04 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:47:04 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:47:04 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:47:04 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:47:04 user nova-compute[82394]:   </clock>
Apr 12 00:47:04 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:47:04 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:47:04 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:47:04 user nova-compute[82394]:   </cpu>
Apr 12 00:47:04 user nova-compute[82394]:   <devices>
Apr 12 00:47:04 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:47:04 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:47:04 user nova-compute[82394]:       <source dev="/dev/sde"/>
Apr 12 00:47:04 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:47:04 user nova-compute[82394]:       <serial>5dcf2dad-f03a-4e7c-8e25-2317b7715d75</serial>
Apr 12 00:47:04 user nova-compute[82394]:     </disk>
Apr 12 00:47:04 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:47:04 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:47:04 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue"/>
Apr 12 00:47:04 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:47:04 user nova-compute[82394]:       <boot order="1"/>
Apr 12 00:47:04 user nova-compute[82394]:     </disk>
Apr 12 00:47:04 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:47:04 user nova-compute[82394]:       <mac address="fa:16:3e:66:e5:85"/>
Apr 12 00:47:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:47:04 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:47:04 user nova-compute[82394]:       <target dev="tap2f72a2ec-42"/>
Apr 12 00:47:04 user nova-compute[82394]:     </interface>
Apr 12 00:47:04 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:47:04 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/console.log" append="off"/>
Apr 12 00:47:04 user nova-compute[82394]:     </serial>
Apr 12 00:47:04 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:47:04 user nova-compute[82394]:     <video>
Apr 12 00:47:04 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:47:04 user nova-compute[82394]:     </video>
Apr 12 00:47:04 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:47:04 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:47:04 user nova-compute[82394]:     </rng>
Apr 12 00:47:04 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:47:04 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:47:04 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:47:04 user nova-compute[82394]:     </memballoon>
Apr 12 00:47:04 user nova-compute[82394]:   </devices>
Apr 12 00:47:04 user nova-compute[82394]: </domain>
Apr 12 00:47:04 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:47:04 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance destroyed successfully.
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:47:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] No VIF found with MAC fa:16:3e:66:e5:85, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:47:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260411.4867358, 533174dc-5071-487b-9a2c-74cd7786af8a => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:06 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] VM Stopped (Lifecycle Event)
Apr 12 00:47:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:06 user nova-compute[82394]: WARNING nova.compute.manager [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state rescuing.
Apr 12 00:47:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5fc5a780-12b6-42c5-b314-d2ac2666707e None None] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for b0c7ca20-c237-43b0-9a75-2a21392c7fd0 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260428.355068, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Resumed (Lifecycle Event)
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:47:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260428.3585994, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Started (Lifecycle Event)
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:47:08 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:08 user nova-compute[82394]: WARNING nova.compute.manager [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state rescuing.
Apr 12 00:47:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:19 user nova-compute[82394]: INFO nova.compute.manager [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Terminating instance
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-unplugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] No waiting events found dispatching network-vif-unplugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-unplugged-9457e7d7-925c-4488-bb2d-c3019a663c42 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:47:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Instance destroyed successfully.
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'resources' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76911330',display_name='tempest-AttachVolumeNegativeTest-server-76911330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76911330',id=35,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWoOc9Cok7OCIn0o1ylURWNrc9FLpoUoG9E4RofMhXE1/xPXUgETixtUirX7kgwq6Uda1/WtQ6DD3WITd65+7Csn8D/LyAnrosTmYHnnOaA6qNkD8YhaIhIQMvIVTLvXA==',key_name='tempest-keypair-1507461507',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:44:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b56f3c567dc84773a33d596920df727a',ramdisk_id='',reservation_id='r-0060ozg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2076679017',owner_user_name='tempest-AttachVolumeNegativeTest-2076679017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d373f582479c441e8ce9849ca694a186',uuid=a346a131-2502-457a-acb8-8f903a7b87a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converting VIF {"id": "9457e7d7-925c-4488-bb2d-c3019a663c42", "address": "fa:16:3e:a6:b6:43", "network": {"id": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1446229885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56f3c567dc84773a33d596920df727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9457e7d7-92", "ovs_interfaceid": "9457e7d7-925c-4488-bb2d-c3019a663c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG os_vif [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9457e7d7-92, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:47:19 user nova-compute[82394]: INFO os_vif [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b6:43,bridge_name='br-int',has_traffic_filtering=True,id=9457e7d7-925c-4488-bb2d-c3019a663c42,network=Network(df248eb3-f39c-4a81-aca0-6c2d01f6d2b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9457e7d7-92')
Apr 12 00:47:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Deleting instance files /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7_del
Apr 12 00:47:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Deletion of /opt/stack/data/nova/instances/a346a131-2502-457a-acb8-8f903a7b87a7_del complete
Apr 12 00:47:20 user nova-compute[82394]: INFO nova.compute.manager [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 00:47:20 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:47:20 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:47:20 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:47:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:20 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:47:21 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Took 0.94 seconds to deallocate network for instance.
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:21 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Deleted allocations for instance a346a131-2502-457a-acb8-8f903a7b87a7
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "a346a131-2502-457a-acb8-8f903a7b87a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Acquiring lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Lock "a346a131-2502-457a-acb8-8f903a7b87a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] No waiting events found dispatching network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:21 user nova-compute[82394]: WARNING nova.compute.manager [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received unexpected event network-vif-plugged-9457e7d7-925c-4488-bb2d-c3019a663c42 for instance with vm_state deleted and task_state None.
Apr 12 00:47:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Received event network-vif-deleted-9457e7d7-925c-4488-bb2d-c3019a663c42 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:34 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260439.9515796, a346a131-2502-457a-acb8-8f903a7b87a7 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:34 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] VM Stopped (Lifecycle Event)
Apr 12 00:47:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-77195a71-38f3-4983-a0b9-6c7528e0304d None None] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:39 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:47:39 user nova-compute[82394]: INFO nova.compute.claims [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Claim successful on node user
Apr 12 00:47:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:47:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.policy [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:47:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Creating image(s)
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk 1073741824" returned: 0 in 0.050s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Cannot resize image /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:47:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'migration_context' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:41 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Successfully created port: f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Successfully updated port: f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing instance network info cache due to event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance network_info: |[{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.neutron [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start _get_guest_xml network_info=[{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:47:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMokxkK7zF60NPptUZtqbNVO4ee0RHPLQ2WdZtjVQCu24iwsegquteqO8OdbQ9GAUZ1SkIIyk/ht01FuuBU5gCdEaHsQ1JWfdkBxOdNOEqXUd7E1coKER+ZBFRQ3Q9eu5A==',key_name='tempest-keypair-1276421029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_devices' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:47:42 user nova-compute[82394]:   <uuid>a4d163ed-7900-486c-8b96-101af5547580</uuid>
Apr 12 00:47:42 user nova-compute[82394]:   <name>instance-00000027</name>
Apr 12 00:47:42 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:47:42 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:47:42 user nova-compute[82394]:   <metadata>
Apr 12 00:47:42 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:47:42 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2121286429</nova:name>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:47:42</nova:creationTime>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:47:42 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:47:42 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:owner>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:user uuid="418881a7e56e4c19bbf900ef71029ce0">tempest-AttachVolumeShelveTestJSON-1335687803-project-member</nova:user>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:project uuid="c26d891933d647b7b27c75915fb726f3">tempest-AttachVolumeShelveTestJSON-1335687803</nova:project>
Apr 12 00:47:42 user nova-compute[82394]:       </nova:owner>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:47:42 user nova-compute[82394]:       <nova:ports>
Apr 12 00:47:42 user nova-compute[82394]:         <nova:port uuid="f10369c7-25e6-4570-86a1-5e9ec3e941be">
Apr 12 00:47:42 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:47:42 user nova-compute[82394]:         </nova:port>
Apr 12 00:47:42 user nova-compute[82394]:       </nova:ports>
Apr 12 00:47:42 user nova-compute[82394]:     </nova:instance>
Apr 12 00:47:42 user nova-compute[82394]:   </metadata>
Apr 12 00:47:42 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:47:42 user nova-compute[82394]:     <system>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="serial">a4d163ed-7900-486c-8b96-101af5547580</entry>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="uuid">a4d163ed-7900-486c-8b96-101af5547580</entry>
Apr 12 00:47:42 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:47:42 user nova-compute[82394]:     </system>
Apr 12 00:47:42 user nova-compute[82394]:   </sysinfo>
Apr 12 00:47:42 user nova-compute[82394]:   <os>
Apr 12 00:47:42 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:47:42 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:47:42 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:47:42 user nova-compute[82394]:   </os>
Apr 12 00:47:42 user nova-compute[82394]:   <features>
Apr 12 00:47:42 user nova-compute[82394]:     <acpi/>
Apr 12 00:47:42 user nova-compute[82394]:     <apic/>
Apr 12 00:47:42 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:47:42 user nova-compute[82394]:   </features>
Apr 12 00:47:42 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:47:42 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:47:42 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:47:42 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:47:42 user nova-compute[82394]:   </clock>
Apr 12 00:47:42 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:47:42 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:47:42 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:47:42 user nova-compute[82394]:   </cpu>
Apr 12 00:47:42 user nova-compute[82394]:   <devices>
Apr 12 00:47:42 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:47:42 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:47:42 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk"/>
Apr 12 00:47:42 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:47:42 user nova-compute[82394]:     </disk>
Apr 12 00:47:42 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:47:42 user nova-compute[82394]:       <mac address="fa:16:3e:76:3d:f9"/>
Apr 12 00:47:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:47:42 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:47:42 user nova-compute[82394]:       <target dev="tapf10369c7-25"/>
Apr 12 00:47:42 user nova-compute[82394]:     </interface>
Apr 12 00:47:42 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:47:42 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/console.log" append="off"/>
Apr 12 00:47:42 user nova-compute[82394]:     </serial>
Apr 12 00:47:42 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:47:42 user nova-compute[82394]:     <video>
Apr 12 00:47:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:47:42 user nova-compute[82394]:     </video>
Apr 12 00:47:42 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:47:42 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:47:42 user nova-compute[82394]:     </rng>
Apr 12 00:47:42 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:47:42 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:47:42 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:47:42 user nova-compute[82394]:     </memballoon>
Apr 12 00:47:42 user nova-compute[82394]:   </devices>
Apr 12 00:47:42 user nova-compute[82394]: </domain>
Apr 12 00:47:42 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMokxkK7zF60NPptUZtqbNVO4ee0RHPLQ2WdZtjVQCu24iwsegquteqO8OdbQ9GAUZ1SkIIyk/ht01FuuBU5gCdEaHsQ1JWfdkBxOdNOEqXUd7E1coKER+ZBFRQ3Q9eu5A==',key_name='tempest-keypair-1276421029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG os_vif [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10369c7-25, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf10369c7-25, col_values=(('external_ids', {'iface-id': 'f10369c7-25e6-4570-86a1-5e9ec3e941be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:3d:f9', 'vm-uuid': 'a4d163ed-7900-486c-8b96-101af5547580'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:42 user nova-compute[82394]: INFO os_vif [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25')
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:47:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No VIF found with MAC fa:16:3e:76:3d:f9, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:47:43 user nova-compute[82394]: DEBUG nova.network.neutron [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updated VIF entry in instance network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:47:43 user nova-compute[82394]: DEBUG nova.network.neutron [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:47:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:47:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:44 user nova-compute[82394]: WARNING nova.compute.manager [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state building and task_state spawning.
Apr 12 00:47:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260466.1206052, a4d163ed-7900-486c-8b96-101af5547580 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Resumed (Lifecycle Event)
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance spawned successfully.
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260466.1236775, a4d163ed-7900-486c-8b96-101af5547580 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Started (Lifecycle Event)
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Took 5.86 seconds to spawn the instance on the hypervisor.
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:47:46 user nova-compute[82394]: INFO nova.compute.manager [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Took 6.52 seconds to build instance.
Apr 12 00:47:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.625s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:47:46 user nova-compute[82394]: WARNING nova.compute.manager [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state active and task_state None.
Apr 12 00:47:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:52 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:47:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:47:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:47:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:47:58 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:47:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:48:01 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:48:01 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=26.160564422607422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a4d163ed-7900-486c-8b96-101af5547580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:48:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:48:03 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [{"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-1277a40a-6389-4d88-bbc6-bda27d465c35" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:48:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing instance network info cache due to event network-changed-df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Acquiring lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Acquired lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:05 user nova-compute[82394]: DEBUG nova.network.neutron [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Refreshing network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:48:06 user nova-compute[82394]: DEBUG nova.network.neutron [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updated VIF entry in instance network info cache for port df061f79-7574-4b3c-9cf4-2b0e61c5efc1. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:48:06 user nova-compute[82394]: DEBUG nova.network.neutron [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Releasing lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Stashing vm_state: active {{(pid=82394) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_requests' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:48:07 user nova-compute[82394]: INFO nova.compute.claims [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Claim successful on node user
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:07 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating resource usage from migration 11349780-4a45-4ff7-bcac-23d7686ca696
Apr 12 00:48:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-changed-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.compute.manager [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Refreshing instance network info cache due to event network-changed-6014f3cd-13ce-4fba-9cba-057192db2b3d. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Refreshing network info cache for port 6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.394s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:07 user nova-compute[82394]: INFO nova.compute.manager [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Migrating
Apr 12 00:48:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updated VIF entry in instance network info cache for port 6014f3cd-13ce-4fba-9cba-057192db2b3d. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:48:08 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:08 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Starting migrate_disk_and_power_off {{(pid=82394) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG nova.compute.manager [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:09 user nova-compute[82394]: WARNING nova.compute.manager [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state active and task_state resize_migrating.
Apr 12 00:48:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:10 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance destroyed successfully.
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6014f3cd-13, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:10 user nova-compute[82394]: INFO os_vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13')
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:48:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fb8ee0-8fd3-4cce-ad27-cc4ea64b7d06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:48:10 user nova-compute[82394]: No targets found.
Apr 12 00:48:10 user nova-compute[82394]: iSNS:
Apr 12 00:48:10 user nova-compute[82394]: No targets found.
Apr 12 00:48:10 user nova-compute[82394]: STATIC:
Apr 12 00:48:10 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:48:10 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:48:10 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:48:10 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:48:10 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:48:10 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:48:10 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:48:10 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:48:10 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:48:10 user nova-compute[82394]: FIRMWARE:
Apr 12 00:48:10 user nova-compute[82394]: No targets found.
Apr 12 00:48:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:48:10 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:48:10 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde317a-4666-4e6f-80e7-ce9db3b09ab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a60eca-4e4f-4417-8a74-83d972af732f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0fd69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5984b832-7079-4da5-84be-80bbecc4e40c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c116c0-cea4-4ef7-b9e9-312051e02a92]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd17a131-55d1-4aac-9b09-6e8fb3099af6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b9814-9859-4cbf-9432-82f1aa25e17e]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_425fe074', '/dev/disk/by-id/scsi-1SCST_BIO425fe074-7e4f3b81ea4dfc15', '/dev/disk/by-id/scsi-23765346633623831') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:48:10 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_425fe074
Apr 12 00:48:10 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO425fe074-7e4f3b81ea4dfc15
Apr 12 00:48:10 user nova-compute[82394]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23765346633623831
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6950a533-5397-4f2b-8133-656a34f968e1]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6e8da-71f1-47e9-a7ea-a9d2e30d4c4a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3137aa82-8aa6-43bb-ad04-5f6915a1ed18]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]
Apr 12 00:48:10 user nova-compute[82394]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.
Apr 12 00:48:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ff02e-7051-4b67-a9e5-2e17d9b1721e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (322ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:48:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Port 6014f3cd-13ce-4fba-9cba-057192db2b3d binding to destination host user is already ACTIVE {{(pid=82394) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:11 user nova-compute[82394]: DEBUG nova.compute.manager [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:11 user nova-compute[82394]: WARNING nova.compute.manager [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state active and task_state resize_migrated.
Apr 12 00:48:12 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7137c-5f50-4b74-b0d9-dac73b128216]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e81b56-baa9-41f0-bca8-e061955d3d06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[92347261-4a05-4047-83b6-13d4eec6f904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be3702e-f087-4652-a17e-c93d1772463a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:48:12 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:48:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ca8b6-2515-4c2a-8753-24b5e3d95a49]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:48:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:48:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Starting finish_migration {{(pid=82394) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:48:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Creating image(s)
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Did not create local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start _get_guest_xml network_info=[{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '25fc59fa-88f7-4633-a77b-9f4b45788b67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749', 'attached_at': '2023-04-12T00:48:16.000000', 'detached_at': '', 'volume_id': 'cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'serial': 'cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:48:16 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:48:16 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:48:16 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:48:16 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:48:16 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3eb9c6-6bb8-4342-b75b-a6db57e6a059]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:48:16 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[38241641-b8fc-4669-bed0-c0404821ab12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7] added
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[069caac5-bdaa-472d-b129-4c7420c224b7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31c43e-ad61-49e5-8f80-c0eac0898e7e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLYFINPy {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLYFINPy" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d54434-a41d-45d4-ba22-702b3958d1d3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLYFINPy'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fe5708-56cd-4027-a072-58ace13d683e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11176014-6760-4144-ab54-28f375ed18b1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92483d9-213a-4605-ae7b-c7490843390b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]
Apr 12 00:48:16 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5414f1-a9f2-4381-8dab-332a8ee5172e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863b27f-f11a-4bc0-b027-ece1274e026e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:48:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:48:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[09397faf-8eed-4a14-88ed-68551e849a4b]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23765346633623831', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765346633623831', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:48:18 user nova-compute[82394]:   <uuid>c7f4b0ac-f740-46b5-99f1-4129cccf1749</uuid>
Apr 12 00:48:18 user nova-compute[82394]:   <name>instance-00000025</name>
Apr 12 00:48:18 user nova-compute[82394]:   <memory>196608</memory>
Apr 12 00:48:18 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:48:18 user nova-compute[82394]:   <metadata>
Apr 12 00:48:18 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:48:18 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:48:18 user nova-compute[82394]:       <nova:name>tempest-ServerActionsTestJSON-server-1379829063</nova:name>
Apr 12 00:48:18 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:48:16</nova:creationTime>
Apr 12 00:48:18 user nova-compute[82394]:       <nova:flavor name="m1.micro">
Apr 12 00:48:18 user nova-compute[82394]:         <nova:memory>192</nova:memory>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:48:18 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:48:18 user nova-compute[82394]:       <nova:owner>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:user uuid="d658147b4def4d12a16381d4c19357e3">tempest-ServerActionsTestJSON-674156571-project-member</nova:user>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:project uuid="d8ba626fdf264b879099a89097845153">tempest-ServerActionsTestJSON-674156571</nova:project>
Apr 12 00:48:18 user nova-compute[82394]:       </nova:owner>
Apr 12 00:48:18 user nova-compute[82394]:       <nova:ports>
Apr 12 00:48:18 user nova-compute[82394]:         <nova:port uuid="6014f3cd-13ce-4fba-9cba-057192db2b3d">
Apr 12 00:48:18 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 00:48:18 user nova-compute[82394]:         </nova:port>
Apr 12 00:48:18 user nova-compute[82394]:       </nova:ports>
Apr 12 00:48:18 user nova-compute[82394]:     </nova:instance>
Apr 12 00:48:18 user nova-compute[82394]:   </metadata>
Apr 12 00:48:18 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:48:18 user nova-compute[82394]:     <system>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="serial">c7f4b0ac-f740-46b5-99f1-4129cccf1749</entry>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="uuid">c7f4b0ac-f740-46b5-99f1-4129cccf1749</entry>
Apr 12 00:48:18 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:48:18 user nova-compute[82394]:     </system>
Apr 12 00:48:18 user nova-compute[82394]:   </sysinfo>
Apr 12 00:48:18 user nova-compute[82394]:   <os>
Apr 12 00:48:18 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:48:18 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:48:18 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:48:18 user nova-compute[82394]:   </os>
Apr 12 00:48:18 user nova-compute[82394]:   <features>
Apr 12 00:48:18 user nova-compute[82394]:     <acpi/>
Apr 12 00:48:18 user nova-compute[82394]:     <apic/>
Apr 12 00:48:18 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:48:18 user nova-compute[82394]:   </features>
Apr 12 00:48:18 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:48:18 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:48:18 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:48:18 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:48:18 user nova-compute[82394]:   </clock>
Apr 12 00:48:18 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:48:18 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:48:18 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:48:18 user nova-compute[82394]:   </cpu>
Apr 12 00:48:18 user nova-compute[82394]:   <devices>
Apr 12 00:48:18 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:48:18 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:48:18 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:48:18 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:48:18 user nova-compute[82394]:       <serial>cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7</serial>
Apr 12 00:48:18 user nova-compute[82394]:     </disk>
Apr 12 00:48:18 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:48:18 user nova-compute[82394]:       <mac address="fa:16:3e:ee:a0:1e"/>
Apr 12 00:48:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:48:18 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:48:18 user nova-compute[82394]:       <target dev="tap6014f3cd-13"/>
Apr 12 00:48:18 user nova-compute[82394]:     </interface>
Apr 12 00:48:18 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:48:18 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749/console.log" append="off"/>
Apr 12 00:48:18 user nova-compute[82394]:     </serial>
Apr 12 00:48:18 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:48:18 user nova-compute[82394]:     <video>
Apr 12 00:48:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:48:18 user nova-compute[82394]:     </video>
Apr 12 00:48:18 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:48:18 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:48:18 user nova-compute[82394]:     </rng>
Apr 12 00:48:18 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:48:18 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:48:18 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:48:18 user nova-compute[82394]:     </memballoon>
Apr 12 00:48:18 user nova-compute[82394]:   </devices>
Apr 12 00:48:18 user nova-compute[82394]: </domain>
Apr 12 00:48:18 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-571118926-network", "vif_mac": "fa:16:3e:ee:a0:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG os_vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6014f3cd-13, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6014f3cd-13, col_values=(('external_ids', {'iface-id': '6014f3cd-13ce-4fba-9cba-057192db2b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:a0:1e', 'vm-uuid': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:18 user nova-compute[82394]: INFO os_vif [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13')
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:48:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] No VIF found with MAC fa:16:3e:ee:a0:1e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:19 user nova-compute[82394]: WARNING nova.compute.manager [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state active and task_state resize_finish.
Apr 12 00:48:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for c7f4b0ac-f740-46b5-99f1-4129cccf1749 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260501.56368, c7f4b0ac-f740-46b5-99f1-4129cccf1749 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] VM Resumed (Lifecycle Event)
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance running successfully.
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Failed to set time: agent not configured {{(pid=82394) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] finish_migration finished successfully. {{(pid=82394) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260501.5654347, c7f4b0ac-f740-46b5-99f1-4129cccf1749 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] VM Started (Lifecycle Event)
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.compute.manager [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Attaching volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 to /dev/vdb
Apr 12 00:48:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:21 user nova-compute[82394]: WARNING nova.compute.manager [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state active and task_state resize_finish.
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.utils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a7beb-929b-4b80-a3ac-4ac77a6757f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6417b8-32ad-4e40-bb85-c2901ed1594f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1907f-dcca-40b5-8b67-724cdb7f7f5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c7b66-a20a-4016-b2d9-9bbe054abbc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:48:21 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:48:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf85220-b637-4b21-92fa-bc636ffa61ad]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG os_brick.utils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:48:21 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating existing volume attachment record: 39616c54-7b1b-4697-9a34-9e29d073026f {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:48:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxugTaos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:48:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:48:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:48:26 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb6fea-fbe7-4d80-a1d6-b193dfcb8209]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:48:26 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb23250-e993-4217-ac12-4d5424db94e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5] added
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[37783511-b5c3-43c8-8c77-2a4e4532c621]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[20951a08-873c-4136-9246-af11220ea697]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxugTaos {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxugTaos" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b986d-9908-4a14-bf65-ebdaca34d7c2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxugTaos'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[034dbf6e-df6d-44c7-8c1d-c974e816e0f9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[694af856-8641-447b-8d49-02b520422d6f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd55b5-3f90-4209-b51f-90cfec0afbde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260]
Apr 12 00:48:26 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260] successful.
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b43e5-6f07-4ebf-9483-fccb5caa9914]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa25699d-a6f6-424f-939e-604ece738dcf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)
Apr 12 00:48:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b2a6a-dd40-4dda-8487-9e62a51b1f4e]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:48:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxugTaos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:48:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:48:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23932376539643562', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:48:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932376539643562', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:48:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:48:28 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:48:28 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:48:28 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:48:28 user nova-compute[82394]:   <serial>35254bb1-a5b6-4517-96c9-7d1df42532a5</serial>
Apr 12 00:48:28 user nova-compute[82394]: </disk>
Apr 12 00:48:28 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] No VIF found with MAC fa:16:3e:69:48:2b, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:48:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.899s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing instance network info cache due to event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updated VIF entry in instance network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing instance network info cache due to event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:33 user nova-compute[82394]: INFO nova.compute.manager [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Rebooting instance
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updated VIF entry in instance network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:33 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:48:34 user nova-compute[82394]: DEBUG nova.network.neutron [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:36 user nova-compute[82394]: WARNING nova.compute.manager [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state active and task_state reboot_started.
Apr 12 00:48:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance shutdown successfully.
Apr 12 00:48:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:38 user nova-compute[82394]: WARNING nova.compute.manager [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state active and task_state reboot_started.
Apr 12 00:48:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:40 user nova-compute[82394]: WARNING nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state active and task_state reboot_started.
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:40 user nova-compute[82394]: WARNING nova.compute.manager [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state active and task_state reboot_started.
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 1fdb2b97-85b9-4e15-b586-948c3804da90 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260520.8665853, 1fdb2b97-85b9-4e15-b586-948c3804da90 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] VM Resumed (Lifecycle Event)
Apr 12 00:48:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance running successfully.
Apr 12 00:48:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance soft rebooted successfully.
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260520.869976, 1fdb2b97-85b9-4e15-b586-948c3804da90 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] VM Started (Lifecycle Event)
Apr 12 00:48:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.708s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:48:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:52 user nova-compute[82394]: INFO nova.compute.manager [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Unrescuing
Apr 12 00:48:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:48:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquired lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:48:52 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:48:52 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG nova.network.neutron [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating instance_info_cache with network_info: [{"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Releasing lock "refresh_cache-b0c7ca20-c237-43b0-9a75-2a21392c7fd0" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'flavor' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:53 user nova-compute[82394]: WARNING nova.compute.manager [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:48:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:54 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance destroyed successfully.
Apr 12 00:48:54 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:54 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:55 user nova-compute[82394]: WARNING nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:48:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:55 user nova-compute[82394]: WARNING nova.compute.manager [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state rescued and task_state unrescuing.
Apr 12 00:48:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for b0c7ca20-c237-43b0-9a75-2a21392c7fd0 due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260537.5310743, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Resumed (Lifecycle Event)
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260537.533061, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:48:57 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Started (Lifecycle Event)
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:48:57 user nova-compute[82394]: WARNING nova.compute.manager [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state None.
Apr 12 00:48:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:48:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:48:59 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:49:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:49:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:49:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=7977MB free_disk=26.14459228515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Applying migration context for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 as it has an incoming, in-progress migration 11349780-4a45-4ff7-bcac-23d7686ca696. Migration status is finished {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 00:49:02 user nova-compute[82394]: INFO nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating resource usage from migration 11349780-4a45-4ff7-bcac-23d7686ca696
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a4d163ed-7900-486c-8b96-101af5547580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Migration 11349780-4a45-4ff7-bcac-23d7686ca696 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:49:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:49:03 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:49:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updating instance_info_cache with network_info: [{"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:49:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-77f09d77-815b-4e7c-905d-b27ae017c9d5" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:49:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:49:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG nova.compute.manager [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing instance network info cache due to event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:49:30 user nova-compute[82394]: DEBUG nova.network.neutron [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:49:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updated VIF entry in instance network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:49:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:49:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:33 user nova-compute[82394]: INFO nova.compute.manager [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Shelving
Apr 12 00:49:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:49:33 user nova-compute[82394]: WARNING nova.compute.manager [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state active and task_state shelving.
Apr 12 00:49:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance destroyed successfully.
Apr 12 00:49:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Beginning cold snapshot process
Apr 12 00:49:33 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:49:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk /opt/stack/data/nova/instances/snapshots/tmpz37fpfc6/4bc76d23db904fa7a24ad749286e4030 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:49:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk /opt/stack/data/nova/instances/snapshots/tmpz37fpfc6/4bc76d23db904fa7a24ad749286e4030" returned: 0 in 0.478s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:49:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Snapshot extracted, beginning image upload
Apr 12 00:49:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:49:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:49:35 user nova-compute[82394]: WARNING nova.compute.manager [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 00:49:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Snapshot image upload complete
Apr 12 00:49:36 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:49:36 user nova-compute[82394]: INFO nova.compute.manager [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Shelve offloading
Apr 12 00:49:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance destroyed successfully.
Apr 12 00:49:36 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:49:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:49:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:49:36 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:49:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance destroyed successfully.
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'resources' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMokxkK7zF60NPptUZtqbNVO4ee0RHPLQ2WdZtjVQCu24iwsegquteqO8OdbQ9GAUZ1SkIIyk/ht01FuuBU5gCdEaHsQ1JWfdkBxOdNOEqXUd7E1coKER+ZBFRQ3Q9eu5A==',key_name='tempest-keypair-1276421029',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:49:36.715722',shelved_host='user',shelved_image_id='178d748a-e21c-4946-8e80-e45a6929ddba'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG os_vif [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10369c7-25, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.compute.manager [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing instance network info cache due to event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.network.neutron [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:49:37 user nova-compute[82394]: INFO os_vif [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25')
Apr 12 00:49:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Deleting instance files /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580_del
Apr 12 00:49:37 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Deletion of /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580_del complete
Apr 12 00:49:37 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Deleted allocations for instance a4d163ed-7900-486c-8b96-101af5547580
Apr 12 00:49:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'numa_topology' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG nova.network.neutron [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updated VIF entry in instance network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG nova.network.neutron [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf10369c7-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:49:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.207s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:48 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260573.723087, a4d163ed-7900-486c-8b96-101af5547580 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:49:48 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Stopped (Lifecycle Event)
Apr 12 00:49:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-73b39998-beed-4d9a-9365-f85337aad668 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:49:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Going to confirm migration 2 {{(pid=82394) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:49:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'info_cache' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'migration_context' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:49:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.377s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:58 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Deleted allocation for migration 11349780-4a45-4ff7-bcac-23d7686ca696
Apr 12 00:49:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.347s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:49:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:49:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:00 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:50:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:50:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:50:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=26.12670135498047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:50:02 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:50:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:50:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [{"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-84861eef-6d59-448b-b6b7-eb8dd8e47b30" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:50:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing instance network info cache due to event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:50:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:50:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:50:24 user nova-compute[82394]: DEBUG nova.network.neutron [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG nova.network.neutron [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updated VIF entry in instance network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG nova.network.neutron [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:25 user nova-compute[82394]: INFO nova.compute.manager [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Detaching volume 35254bb1-a5b6-4517-96c9-7d1df42532a5
Apr 12 00:50:26 user nova-compute[82394]: INFO nova.virt.block_device [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Attempting to driver detach volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 from mountpoint /dev/vdb
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Attempting to detach device vdb from instance 1fdb2b97-85b9-4e15-b586-948c3804da90 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:50:26 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:50:26 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:50:26 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:50:26 user nova-compute[82394]:   <serial>35254bb1-a5b6-4517-96c9-7d1df42532a5</serial>
Apr 12 00:50:26 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:50:26 user nova-compute[82394]: </disk>
Apr 12 00:50:26 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:50:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully detached device vdb from instance 1fdb2b97-85b9-4e15-b586-948c3804da90 from the persistent domain config.
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fdb2b97-85b9-4e15-b586-948c3804da90 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:50:26 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:50:26 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:50:26 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:50:26 user nova-compute[82394]:   <serial>35254bb1-a5b6-4517-96c9-7d1df42532a5</serial>
Apr 12 00:50:26 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 00:50:26 user nova-compute[82394]: </disk>
Apr 12 00:50:26 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260626.5634336, 1fdb2b97-85b9-4e15-b586-948c3804da90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:50:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully detached device vdb from instance 1fdb2b97-85b9-4e15-b586-948c3804da90 from the live domain config.
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxugTaos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:50:26 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ec325-85ff-4b4e-a41d-5ccc211f2c13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:50:26 user nova-compute[82394]: No targets found.
Apr 12 00:50:26 user nova-compute[82394]: iSNS:
Apr 12 00:50:26 user nova-compute[82394]: No targets found.
Apr 12 00:50:26 user nova-compute[82394]: STATIC:
Apr 12 00:50:26 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:50:26 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:26 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:26 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:50:26 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:26 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:26 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:50:26 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:26 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:26 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5
Apr 12 00:50:26 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:26 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:26 user nova-compute[82394]: FIRMWARE:
Apr 12 00:50:26 user nova-compute[82394]: No targets found.
Apr 12 00:50:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:50:26 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:50:26 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1cf4c7-9738-4a06-a3cc-85f370789556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cd9c7-613e-4b22-8877-79f81d47d97d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 (non-flash)
Apr 12 00:50:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb234131d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[25627187-f94e-4469-855e-38f6af3ef5a4]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing instance network info cache due to event network-changed-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Acquiring lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Acquired lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.network.neutron [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Refreshing network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3e3a0-41b3-4efa-8c95-ad4d54502f03]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4f1ff0-4592-45a2-bd20-97dbec165e20]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af0c35-9713-401c-b9b1-5ccc600f1715]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca3c9a-499c-4139-94a6-0f823190b470]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ce059-12f1-4bdb-bd61-ff2b51a706cc]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260]
Apr 12 00:50:26 user nova-compute[82394]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5, portal: 172.16.0.220,3260] successful.
Apr 12 00:50:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35254bb1-a5b6-4517-96c9-7d1df42532a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5a04a-f40d-43e5-bcb0-38a943aae122]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] <== disconnect_volume: return (314ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:50:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updated VIF entry in instance network info cache for port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG nova.network.neutron [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [{"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Releasing lock "refresh_cache-1fdb2b97-85b9-4e15-b586-948c3804da90" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'flavor' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.826s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:42 user nova-compute[82394]: INFO nova.compute.manager [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Terminating instance
Apr 12 00:50:42 user nova-compute[82394]: DEBUG nova.compute.manager [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-unplugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Instance destroyed successfully.
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.objects.instance [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1944310669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1944310669',id=36,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-xnsfofib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:48:58Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=b0c7ca20-c237-43b0-9a75-2a21392c7fd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "address": "fa:16:3e:66:e5:85", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f72a2ec-42", "ovs_interfaceid": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_vif [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f72a2ec-42, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:50:43 user nova-compute[82394]: INFO os_vif [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e5:85,bridge_name='br-int',has_traffic_filtering=True,id=2f72a2ec-42e3-4239-bf22-a5ecc61aedcf,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f72a2ec-42')
Apr 12 00:50:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZeFvQrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:50:43 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee438e65-734f-4edd-a774-0957554fddb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:50:43 user nova-compute[82394]: No targets found.
Apr 12 00:50:43 user nova-compute[82394]: iSNS:
Apr 12 00:50:43 user nova-compute[82394]: No targets found.
Apr 12 00:50:43 user nova-compute[82394]: STATIC:
Apr 12 00:50:43 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75
Apr 12 00:50:43 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:43 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:43 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:50:43 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:43 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:43 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:50:43 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:50:43 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:50:43 user nova-compute[82394]: FIRMWARE:
Apr 12 00:50:43 user nova-compute[82394]: No targets found.
Apr 12 00:50:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:50:43 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:50:43 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc8ba0-a1a2-4b1e-aa50-effec4031ef2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf3acbc-695f-44a4-9046-1cec21e92008]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:50:43 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347c68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75'): ({'sde'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Removing single pathed devices sde {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eca3a3-3b83-428c-bbe6-a1c69c592b08]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[85366536-7dfe-46b4-b4f2-56cfe0149fdf]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flushing IO for device /dev/sde {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020961f-32fa-4170-b5a3-db4ffef7c774]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb6686-6914-49d2-9aef-ff308eca45b5]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] SCSI volumes sde have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO64a07706-73f97e5f11dcd30a', '/dev/disk/by-id/scsi-23733663937653566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_64a07706') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[805207d8-4fb3-43ea-97b2-74822df58bff]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf670c1a-ca52-47c0-af02-dab90b901aef]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:43 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa878c-fee5-421a-b80e-f044c38f2e7f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260]
Apr 12 00:50:44 user nova-compute[82394]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75, portal: 172.16.0.220,3260] successful.
Apr 12 00:50:44 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcf2dad-f03a-4e7c-8e25-2317b7715d75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45418a-324c-43c7-81ef-0d3899cc04ee]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== disconnect_volume: return (338ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:50:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Deleting instance files /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0_del
Apr 12 00:50:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Deletion of /opt/stack/data/nova/instances/b0c7ca20-c237-43b0-9a75-2a21392c7fd0_del complete
Apr 12 00:50:44 user nova-compute[82394]: INFO nova.compute.manager [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 00:50:44 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:50:44 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:50:44 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Took 0.45 seconds to deallocate network for instance.
Apr 12 00:50:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Acquiring lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] No waiting events found dispatching network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:50:45 user nova-compute[82394]: WARNING nova.compute.manager [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received unexpected event network-vif-plugged-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance with vm_state active and task_state deleting.
Apr 12 00:50:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Received event network-vif-deleted-2f72a2ec-42e3-4239-bf22-a5ecc61aedcf {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:50:45 user nova-compute[82394]: INFO nova.compute.manager [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:45 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Deleted allocations for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0
Apr 12 00:50:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "b0c7ca20-c237-43b0-9a75-2a21392c7fd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:50:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:53 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:50:57 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:50:58 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260643.687768, b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:50:58 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] VM Stopped (Lifecycle Event)
Apr 12 00:50:58 user nova-compute[82394]: DEBUG nova.compute.manager [None req-39d44559-2e9a-4dca-a5c9-eba23ca7f0b9 None None] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:50:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:50:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:51:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:51:03 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:51:03 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8318MB free_disk=26.11773681640625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:51:03 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:51:04 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:51:04 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:51:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:51:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [{"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-c7f4b0ac-f740-46b5-99f1-4129cccf1749" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:51:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:51:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:51:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:18 user nova-compute[82394]: INFO nova.compute.manager [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Terminating instance
Apr 12 00:51:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:18 user nova-compute[82394]: DEBUG nova.compute.manager [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-unplugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Instance destroyed successfully.
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'resources' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381148789',display_name='tempest-TestMinimumBasicScenario-server-381148789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381148789',id=38,image_ref='31461e92-139a-4213-a81b-97f686de3b0e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKUjMUHJg1ZJrVvMP4uF5S0HHA87ZxyaAz9hfCYZiiiib71m38Sm7mvxr0QpYkB8Gavhzox7dRsXgcBgTh+Oh0K1TRPHl0cUmphSvbOmnIOmcwihIPv00AoperWHPnpYQ==',key_name='tempest-TestMinimumBasicScenario-609117724',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66fda80cb83402392e155c76ee78e1f',ramdisk_id='',reservation_id='r-r15tteuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31461e92-139a-4213-a81b-97f686de3b0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1682364358',owner_user_name='tempest-TestMinimumBasicScenario-1682364358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:48:41Z,user_data=None,user_id='2842535891eb4a9880f7e8859dd0de3c',uuid=1fdb2b97-85b9-4e15-b586-948c3804da90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converting VIF {"id": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "address": "fa:16:3e:69:48:2b", "network": {"id": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-454049282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66fda80cb83402392e155c76ee78e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb145d6f4-4a", "ovs_interfaceid": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG os_vif [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb145d6f4-4a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:51:19 user nova-compute[82394]: INFO os_vif [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:2b,bridge_name='br-int',has_traffic_filtering=True,id=b145d6f4-4a6d-4ab7-9797-6a0b15f165e7,network=Network(f0cb3c70-3fb7-45b5-8454-846b0c4b7a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb145d6f4-4a')
Apr 12 00:51:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Deleting instance files /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90_del
Apr 12 00:51:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Deletion of /opt/stack/data/nova/instances/1fdb2b97-85b9-4e15-b586-948c3804da90_del complete
Apr 12 00:51:19 user nova-compute[82394]: INFO nova.compute.manager [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 00:51:19 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:51:19 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Took 0.57 seconds to deallocate network for instance.
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-deleted-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:51:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:20 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Deleted allocations for instance 1fdb2b97-85b9-4e15-b586-948c3804da90
Apr 12 00:51:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:21 user nova-compute[82394]: WARNING nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state deleted and task_state None.
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:21 user nova-compute[82394]: WARNING nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state deleted and task_state None.
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:21 user nova-compute[82394]: WARNING nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state deleted and task_state None.
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Acquiring lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "1fdb2b97-85b9-4e15-b586-948c3804da90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] No waiting events found dispatching network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:21 user nova-compute[82394]: WARNING nova.compute.manager [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Received unexpected event network-vif-plugged-b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance with vm_state deleted and task_state None.
Apr 12 00:51:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:51:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:25 user nova-compute[82394]: INFO nova.compute.manager [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Unshelving
Apr 12 00:51:25 user nova-compute[82394]: INFO nova.virt.block_device [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Booting with volume 75e5c02c-524d-4965-85ea-092f7700dce2 at /dev/vdc
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f81d77e-7c77-4386-bc3d-6bbfb6f1d1a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a36a13-77c3-439c-b639-4abaf5db6973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9978243-fd15-4b83-9e16-f03150176fb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f862114-1fa6-422d-a2c6-88d78b457f48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:51:25 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:51:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08fce2d-8d89-414a-a859-83e2160b05e3]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG os_brick.utils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:51:25 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating existing volume attachment record: 11f734c0-ea03-4ba4-8022-acd54c161ef2 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:51:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_requests' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'numa_topology' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:51:30 user nova-compute[82394]: INFO nova.compute.claims [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Claim successful on node user
Apr 12 00:51:30 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:51:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:30 user nova-compute[82394]: INFO nova.network.neutron [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating port f10369c7-25e6-4570-86a1-5e9ec3e941be with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing instance network info cache due to event network-changed-f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Acquiring lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.network.neutron [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:51:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Creating image(s)
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Acquired lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG nova.network.neutron [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Refreshing network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "ee4f62c1afd903097aa029248ce017aebb763b19" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "ee4f62c1afd903097aa029248ce017aebb763b19" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG nova.virt.images [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 178d748a-e21c-4946-8e80-e45a6929ddba was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.part /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.part /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.converted" returned: 0 in 0.283s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG nova.network.neutron [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updated VIF entry in instance network info cache for port f10369c7-25e6-4570-86a1-5e9ec3e941be. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG nova.network.neutron [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:51:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Releasing lock "refresh_cache-a4d163ed-7900-486c-8b96-101af5547580" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "ee4f62c1afd903097aa029248ce017aebb763b19" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.306s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "ee4f62c1afd903097aa029248ce017aebb763b19" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "ee4f62c1afd903097aa029248ce017aebb763b19" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19,backing_fmt=raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19,backing_fmt=raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk 1073741824" returned: 0 in 0.046s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "ee4f62c1afd903097aa029248ce017aebb763b19" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'migration_context' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:33 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Rebasing disk image.
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:33 user nova-compute[82394]: INFO nova.compute.manager [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Terminating instance
Apr 12 00:51:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 -F raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-unplugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] No waiting events found dispatching network-vif-unplugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-unplugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260679.2984197, 1fdb2b97-85b9-4e15-b586-948c3804da90 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:51:34 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] VM Stopped (Lifecycle Event)
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-91a69a63-18ba-403d-9ce2-b57c042fc901 None None] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Instance destroyed successfully.
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid 77f09d77-815b-4e7c-905d-b27ae017c9d5 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-336796070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-336796070',id=32,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-cst9omcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:44:09Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=77f09d77-815b-4e7c-905d-b27ae017c9d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "address": "fa:16:3e:c3:c5:c8", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95181ee0-bb", "ovs_interfaceid": "95181ee0-bb75-49a0-ad95-a2c225ff5f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG os_vif [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95181ee0-bb, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:51:34 user nova-compute[82394]: INFO os_vif [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=95181ee0-bb75-49a0-ad95-a2c225ff5f51,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95181ee0-bb')
Apr 12 00:51:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Deleting instance files /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5_del
Apr 12 00:51:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Deletion of /opt/stack/data/nova/instances/77f09d77-815b-4e7c-905d-b27ae017c9d5_del complete
Apr 12 00:51:34 user nova-compute[82394]: INFO nova.compute.manager [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 00:51:34 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:51:34 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:51:35 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Took 0.54 seconds to deallocate network for instance.
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:35 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Deleted allocations for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 -F raw /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk" returned: 0 in 2.057s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start _get_guest_xml network_info=[{"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3a134d46a4e19940cca0e9201ec8ed6c',container_format='bare',created_at=2023-04-12T00:49:33Z,direct_url=<?>,disk_format='qcow2',id=178d748a-e21c-4946-8e80-e45a6929ddba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2121286429-shelved',owner='c26d891933d647b7b27c75915fb726f3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T00:49:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '11f734c0-ea03-4ba4-8022-acd54c161ef2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGvmMSok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a4d163ed-7900-486c-8b96-101af5547580', 'attached_at': '', 'detached_at': '', 'volume_id': '75e5c02c-524d-4965-85ea-092f7700dce2', 'serial': '75e5c02c-524d-4965-85ea-092f7700dce2'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:51:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:51:35 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3a134d46a4e19940cca0e9201ec8ed6c',container_format='bare',created_at=2023-04-12T00:49:33Z,direct_url=<?>,disk_format='qcow2',id=178d748a-e21c-4946-8e80-e45a6929ddba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2121286429-shelved',owner='c26d891933d647b7b27c75915fb726f3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T00:49:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGvmMSok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:51:35 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:51:35 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:51:35 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6713e6-cc5d-4581-8ac7-41c611c4f616]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:51:35 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e1998-ef31-484f-8d33-db9859ba162e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2] added
Apr 12 00:51:35 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[299baf9e-eabb-4394-b7fe-0e91d91e032d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a632e3-7b1e-4b22-bfe6-edd973e86104]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGvmMSok {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGvmMSok" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[469391cb-d445-46ef-85a2-4a5a2d3151ac]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGvmMSok'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b05a8-83e7-444e-b4a2-c00affa13ad0]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb71977-58fa-4a09-9807-b21db5990317]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:51:35 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:51:35 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:51:35 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:51:35 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:51:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[45474be7-5f73-4dbe-b3ec-19a460ada297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260]
Apr 12 00:51:36 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260] successful.
Apr 12 00:51:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5129ea90-5c70-4de1-95e6-b156365c633c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Acquiring lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Lock "77f09d77-815b-4e7c-905d-b27ae017c9d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] No waiting events found dispatching network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:36 user nova-compute[82394]: WARNING nova.compute.manager [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received unexpected event network-vif-plugged-95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance with vm_state deleted and task_state None.
Apr 12 00:51:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Received event network-vif-deleted-95181ee0-bb75-49a0-ad95-a2c225ff5f51 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5779c7-fc44-43ff-b9cf-ce0395326673]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:51:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5115b-c747-45d6-9e71-7e494168e904]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:51:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGvmMSok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23666303238393737', 'path': '/dev/sdd'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303238393737', 'path': '/dev/sdd'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='178d748a-e21c-4946-8e80-e45a6929ddba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1276421029',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:49:36.715722',shelved_host='user',shelved_image_id='178d748a-e21c-4946-8e80-e45a6929ddba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_devices' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:51:37 user nova-compute[82394]:   <uuid>a4d163ed-7900-486c-8b96-101af5547580</uuid>
Apr 12 00:51:37 user nova-compute[82394]:   <name>instance-00000027</name>
Apr 12 00:51:37 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:51:37 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:51:37 user nova-compute[82394]:   <metadata>
Apr 12 00:51:37 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:51:37 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2121286429</nova:name>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:51:35</nova:creationTime>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:51:37 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:51:37 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:owner>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:user uuid="418881a7e56e4c19bbf900ef71029ce0">tempest-AttachVolumeShelveTestJSON-1335687803-project-member</nova:user>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:project uuid="c26d891933d647b7b27c75915fb726f3">tempest-AttachVolumeShelveTestJSON-1335687803</nova:project>
Apr 12 00:51:37 user nova-compute[82394]:       </nova:owner>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:root type="image" uuid="178d748a-e21c-4946-8e80-e45a6929ddba"/>
Apr 12 00:51:37 user nova-compute[82394]:       <nova:ports>
Apr 12 00:51:37 user nova-compute[82394]:         <nova:port uuid="f10369c7-25e6-4570-86a1-5e9ec3e941be">
Apr 12 00:51:37 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 00:51:37 user nova-compute[82394]:         </nova:port>
Apr 12 00:51:37 user nova-compute[82394]:       </nova:ports>
Apr 12 00:51:37 user nova-compute[82394]:     </nova:instance>
Apr 12 00:51:37 user nova-compute[82394]:   </metadata>
Apr 12 00:51:37 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:51:37 user nova-compute[82394]:     <system>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="serial">a4d163ed-7900-486c-8b96-101af5547580</entry>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="uuid">a4d163ed-7900-486c-8b96-101af5547580</entry>
Apr 12 00:51:37 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:51:37 user nova-compute[82394]:     </system>
Apr 12 00:51:37 user nova-compute[82394]:   </sysinfo>
Apr 12 00:51:37 user nova-compute[82394]:   <os>
Apr 12 00:51:37 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:51:37 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:51:37 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:51:37 user nova-compute[82394]:   </os>
Apr 12 00:51:37 user nova-compute[82394]:   <features>
Apr 12 00:51:37 user nova-compute[82394]:     <acpi/>
Apr 12 00:51:37 user nova-compute[82394]:     <apic/>
Apr 12 00:51:37 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:51:37 user nova-compute[82394]:   </features>
Apr 12 00:51:37 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:51:37 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:51:37 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:51:37 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:51:37 user nova-compute[82394]:   </clock>
Apr 12 00:51:37 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:51:37 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:51:37 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:51:37 user nova-compute[82394]:   </cpu>
Apr 12 00:51:37 user nova-compute[82394]:   <devices>
Apr 12 00:51:37 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:51:37 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:51:37 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk"/>
Apr 12 00:51:37 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:51:37 user nova-compute[82394]:     </disk>
Apr 12 00:51:37 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:51:37 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:51:37 user nova-compute[82394]:       <source dev="/dev/sdd"/>
Apr 12 00:51:37 user nova-compute[82394]:       <target dev="vdc" bus="virtio"/>
Apr 12 00:51:37 user nova-compute[82394]:       <serial>75e5c02c-524d-4965-85ea-092f7700dce2</serial>
Apr 12 00:51:37 user nova-compute[82394]:     </disk>
Apr 12 00:51:37 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:51:37 user nova-compute[82394]:       <mac address="fa:16:3e:76:3d:f9"/>
Apr 12 00:51:37 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:51:37 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:51:37 user nova-compute[82394]:       <target dev="tapf10369c7-25"/>
Apr 12 00:51:37 user nova-compute[82394]:     </interface>
Apr 12 00:51:37 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:51:37 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/console.log" append="off"/>
Apr 12 00:51:37 user nova-compute[82394]:     </serial>
Apr 12 00:51:37 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:51:37 user nova-compute[82394]:     <video>
Apr 12 00:51:37 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:51:37 user nova-compute[82394]:     </video>
Apr 12 00:51:37 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:51:37 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:51:37 user nova-compute[82394]:     </rng>
Apr 12 00:51:37 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:51:37 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:51:37 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:51:37 user nova-compute[82394]:     </memballoon>
Apr 12 00:51:37 user nova-compute[82394]:   </devices>
Apr 12 00:51:37 user nova-compute[82394]: </domain>
Apr 12 00:51:37 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='178d748a-e21c-4946-8e80-e45a6929ddba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1276421029',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:49:36.715722',shelved_host='user',shelved_image_id='178d748a-e21c-4946-8e80-e45a6929ddba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG os_vif [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10369c7-25, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf10369c7-25, col_values=(('external_ids', {'iface-id': 'f10369c7-25e6-4570-86a1-5e9ec3e941be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:3d:f9', 'vm-uuid': 'a4d163ed-7900-486c-8b96-101af5547580'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:37 user nova-compute[82394]: INFO os_vif [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25')
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:51:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No VIF found with MAC fa:16:3e:76:3d:f9, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:38 user nova-compute[82394]: WARNING nova.compute.manager [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:51:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260700.7670686, a4d163ed-7900-486c-8b96-101af5547580 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:51:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Resumed (Lifecycle Event)
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:51:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance spawned successfully.
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:51:40 user nova-compute[82394]: WARNING nova.compute.manager [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:51:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260700.7699184, a4d163ed-7900-486c-8b96-101af5547580 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:51:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Started (Lifecycle Event)
Apr 12 00:51:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:51:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:51:40 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:51:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:51:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.612s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:51:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:47 user nova-compute[82394]: INFO nova.compute.manager [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Get console output
Apr 12 00:51:48 user nova-compute[82394]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 00:51:49 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260694.4420302, 77f09d77-815b-4e7c-905d-b27ae017c9d5 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:51:49 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] VM Stopped (Lifecycle Event)
Apr 12 00:51:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-ffe9bcc6-2761-46b8-8ec8-0ff9b31b3086 None None] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:51:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:55 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:51:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:51:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:52:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:52:02 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:52:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:52:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:52:04 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=26.210304260253906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a4d163ed-7900-486c-8b96-101af5547580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:52:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:52:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:24 user nova-compute[82394]: INFO nova.compute.manager [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Terminating instance
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-unplugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:52:24 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Instance destroyed successfully.
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-241003630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-241003630',id=23,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-usfiymz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:40:27Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=1277a40a-6389-4d88-bbc6-bda27d465c35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "address": "fa:16:3e:84:89:8e", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e32719d-1d", "ovs_interfaceid": "8e32719d-1d2e-439a-9dba-9ac82140fbac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_vif [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e32719d-1d, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:52:24 user nova-compute[82394]: INFO os_vif [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:8e,bridge_name='br-int',has_traffic_filtering=True,id=8e32719d-1d2e-439a-9dba-9ac82140fbac,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e32719d-1d')
Apr 12 00:52:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhQHbDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:52:24 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8963d297-dbee-4b21-80da-7a5edd62e8de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:52:24 user nova-compute[82394]: No targets found.
Apr 12 00:52:24 user nova-compute[82394]: iSNS:
Apr 12 00:52:24 user nova-compute[82394]: No targets found.
Apr 12 00:52:24 user nova-compute[82394]: STATIC:
Apr 12 00:52:24 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:52:24 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:52:24 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:52:24 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2
Apr 12 00:52:24 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:52:24 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:52:24 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7
Apr 12 00:52:24 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:52:24 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:52:24 user nova-compute[82394]: FIRMWARE:
Apr 12 00:52:24 user nova-compute[82394]: No targets found.
Apr 12 00:52:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:52:24 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:52:24 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dd3aae-8020-4006-b53f-25fb41e8bebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e758dcbf-88ee-4b0c-9769-846745c58632]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:52:24 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343ce950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7'): ({'sdc'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Removing single pathed devices sdc {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358c9d6-d7e8-4387-b972-bf5e92751d18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc381aeb-71f0-44d4-aaea-e5352ac4f611]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flushing IO for device /dev/sdc {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a374e4-1232-4a57-b190-a1da64c8e28b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3f734-edee-437d-8f67-688fde458c05]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f30ba0-c643-4678-bd48-168631cd5196]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e42b36b-4b70-4d87-86f8-6c4daafc8e30]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260]
Apr 12 00:52:25 user nova-compute[82394]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7, portal: 172.16.0.220,3260] successful.
Apr 12 00:52:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b6e07b-a45a-42a0-92d7-19f59724fca7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807596a-b1d5-48ca-a161-b853cd72131e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] <== disconnect_volume: return (327ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:52:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Deleting instance files /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35_del
Apr 12 00:52:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Deletion of /opt/stack/data/nova/instances/1277a40a-6389-4d88-bbc6-bda27d465c35_del complete
Apr 12 00:52:25 user nova-compute[82394]: INFO nova.compute.manager [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 00:52:25 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:52:25 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:52:25 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Took 0.53 seconds to deallocate network for instance.
Apr 12 00:52:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-deleted-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:26 user nova-compute[82394]: INFO nova.compute.manager [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Acquiring lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] No waiting events found dispatching network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:52:26 user nova-compute[82394]: WARNING nova.compute.manager [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Received unexpected event network-vif-plugged-8e32719d-1d2e-439a-9dba-9ac82140fbac for instance with vm_state deleted and task_state None.
Apr 12 00:52:26 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:26 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Deleted allocations for instance 1277a40a-6389-4d88-bbc6-bda27d465c35
Apr 12 00:52:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "1277a40a-6389-4d88-bbc6-bda27d465c35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.723s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:52:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:39 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260744.6730242, 1277a40a-6389-4d88-bbc6-bda27d465c35 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:52:39 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] VM Stopped (Lifecycle Event)
Apr 12 00:52:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4b83bdad-21fb-4a77-9b2e-9407791854bb None None] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:52:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:48 user nova-compute[82394]: INFO nova.compute.manager [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Terminating instance
Apr 12 00:52:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:52:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-unplugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Instance destroyed successfully.
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.objects.instance [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid c7f4b0ac-f740-46b5-99f1-4129cccf1749 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1379829063',display_name='tempest-ServerActionsTestJSON-server-1379829063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1379829063',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-0u7atd0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=c7f4b0ac-f740-46b5-99f1-4129cccf1749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "address": "fa:16:3e:ee:a0:1e", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6014f3cd-13", "ovs_interfaceid": "6014f3cd-13ce-4fba-9cba-057192db2b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_vif [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6014f3cd-13, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:52:49 user nova-compute[82394]: INFO os_vif [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:a0:1e,bridge_name='br-int',has_traffic_filtering=True,id=6014f3cd-13ce-4fba-9cba-057192db2b3d,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6014f3cd-13')
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLYFINPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:52:49 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f6dc0-b710-419f-a25c-d60c787d37f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:52:49 user nova-compute[82394]: No targets found.
Apr 12 00:52:49 user nova-compute[82394]: iSNS:
Apr 12 00:52:49 user nova-compute[82394]: No targets found.
Apr 12 00:52:49 user nova-compute[82394]: STATIC:
Apr 12 00:52:49 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7
Apr 12 00:52:49 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:52:49 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:52:49 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2
Apr 12 00:52:49 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:52:49 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:52:49 user nova-compute[82394]: FIRMWARE:
Apr 12 00:52:49 user nova-compute[82394]: No targets found.
Apr 12 00:52:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:52:49 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:52:49 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb217e6-f7ae-45d6-869b-f1e611eb52b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1595b1-aac7-4640-9ac8-9492e24675fe]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:52:49 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:52:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 (non-flash)
Apr 12 00:52:49 user nova-compute[82394]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:52:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23436eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7f14b1-2192-46c6-ad07-651897d11ee6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[20585ca5-dd7d-4f30-93ae-8e09af8671e1]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f48eeb-2849-4f86-8db0-2252020e27fc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfdefbf-ba4d-46f4-85ee-37602a2aa994]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_425fe074', '/dev/disk/by-id/scsi-1SCST_BIO425fe074-7e4f3b81ea4dfc15', '/dev/disk/by-id/scsi-23765346633623831') {{(pid=92359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b97d6-fc27-4139-807d-5c50faf36065]: (4, None) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e054d26-5d2c-4360-a758-8584b70ec462]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3939073a-bdcd-402b-b143-7475a474cca1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260]
Apr 12 00:52:49 user nova-compute[82394]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7, portal: 172.16.0.220,3260] successful.
Apr 12 00:52:49 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9365042-7785-412f-a278-555bc75400f6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] <== disconnect_volume: return (283ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:52:49 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:52:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Deleting instance files /opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749_del
Apr 12 00:52:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Deletion of /opt/stack/data/nova/instances/c7f4b0ac-f740-46b5-99f1-4129cccf1749_del complete
Apr 12 00:52:50 user nova-compute[82394]: INFO nova.compute.manager [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 12 00:52:50 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:52:50 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:52:50 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:52:50 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:52:50 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Took 0.77 seconds to deallocate network for instance.
Apr 12 00:52:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Acquiring lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] No waiting events found dispatching network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:52:51 user nova-compute[82394]: WARNING nova.compute.manager [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received unexpected event network-vif-plugged-6014f3cd-13ce-4fba-9cba-057192db2b3d for instance with vm_state active and task_state deleting.
Apr 12 00:52:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Received event network-vif-deleted-6014f3cd-13ce-4fba-9cba-057192db2b3d {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:52:51 user nova-compute[82394]: INFO nova.compute.manager [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 00:52:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Deleting volume: cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7 {{(pid=82394) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:52:51 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:52:52 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:52:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:52 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Deleted allocations for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749
Apr 12 00:52:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "c7f4b0ac-f740-46b5-99f1-4129cccf1749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:52:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:52:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:52:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:53:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260769.6740553, c7f4b0ac-f740-46b5-99f1-4129cccf1749 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:53:04 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] VM Stopped (Lifecycle Event)
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG nova.compute.manager [None req-10b17b93-be43-4a41-8668-80f66c74114d None None] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:53:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:05 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:53:05 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=26.239112854003906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a4d163ed-7900-486c-8b96-101af5547580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:53:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:53:06 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:53:07 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [{"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:53:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:53:07 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:53:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:14 user nova-compute[82394]: INFO nova.compute.manager [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Terminating instance
Apr 12 00:53:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-unplugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] No waiting events found dispatching network-vif-unplugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.compute.manager [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-unplugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Instance destroyed successfully.
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'resources' on Instance uuid a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1962160944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1962160944',id=15,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4a7eb4a2a09418eacdeaccefbf7de15',ramdisk_id='',reservation_id='r-057en8me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-410532057',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:35:38Z,user_data=None,user_id='69d6e340820641729772cf35648ef785',uuid=a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converting VIF {"id": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "address": "fa:16:3e:bb:16:d4", "network": {"id": "2e59f1f4-986f-4135-b7f2-1d333d3017ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1311712825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4a7eb4a2a09418eacdeaccefbf7de15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d6c33-a0", "ovs_interfaceid": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG os_vif [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203d6c33-a0, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:15 user nova-compute[82394]: INFO os_vif [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:16:d4,bridge_name='br-int',has_traffic_filtering=True,id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5,network=Network(2e59f1f4-986f-4135-b7f2-1d333d3017ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d6c33-a0')
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Deleting instance files /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88_del
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Deletion of /opt/stack/data/nova/instances/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88_del complete
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.compute.manager [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.compute.manager [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Detaching volume 75e5c02c-524d-4965-85ea-092f7700dce2
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.virt.block_device [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Attempting to driver detach volume 75e5c02c-524d-4965-85ea-092f7700dce2 from mountpoint /dev/vdc
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Attempting to detach device vdc from instance a4d163ed-7900-486c-8b96-101af5547580 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:53:15 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:53:15 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:53:15 user nova-compute[82394]:   <target dev="vdc" bus="virtio"/>
Apr 12 00:53:15 user nova-compute[82394]:   <serial>75e5c02c-524d-4965-85ea-092f7700dce2</serial>
Apr 12 00:53:15 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:53:15 user nova-compute[82394]: </disk>
Apr 12 00:53:15 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:53:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully detached device vdc from instance a4d163ed-7900-486c-8b96-101af5547580 from the persistent domain config.
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a4d163ed-7900-486c-8b96-101af5547580 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 00:53:15 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:53:15 user nova-compute[82394]:   <source dev="/dev/sdd"/>
Apr 12 00:53:15 user nova-compute[82394]:   <target dev="vdc" bus="virtio"/>
Apr 12 00:53:15 user nova-compute[82394]:   <serial>75e5c02c-524d-4965-85ea-092f7700dce2</serial>
Apr 12 00:53:15 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 00:53:15 user nova-compute[82394]: </disk>
Apr 12 00:53:15 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 00:53:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:53:16 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Took 0.50 seconds to deallocate network for instance.
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-deleted-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:16 user nova-compute[82394]: INFO nova.compute.manager [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Neutron deleted interface 203d6c33-a06b-4c9a-88e9-dbd8e823a6e5; detaching it from the instance and deleting it from the info cache
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.network.neutron [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.compute.manager [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Detach interface failed, port_id=203d6c33-a06b-4c9a-88e9-dbd8e823a6e5, reason: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681260796.2613392, a4d163ed-7900-486c-8b96-101af5547580 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 00:53:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully detached device vdc from instance a4d163ed-7900-486c-8b96-101af5547580 from the live domain config.
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGvmMSok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:53:16 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b964f-cd5f-411d-83ce-f29f3639f68e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 00:53:16 user nova-compute[82394]: No targets found.
Apr 12 00:53:16 user nova-compute[82394]: iSNS:
Apr 12 00:53:16 user nova-compute[82394]: No targets found.
Apr 12 00:53:16 user nova-compute[82394]: STATIC:
Apr 12 00:53:16 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2
Apr 12 00:53:16 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 00:53:16 user nova-compute[82394]:                 Iface Name: default
Apr 12 00:53:16 user nova-compute[82394]: FIRMWARE:
Apr 12 00:53:16 user nova-compute[82394]: No targets found.
Apr 12 00:53:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 00:53:16 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 00:53:16 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8065912-0d1c-43e0-9fca-f4811bba35ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6fe01e-a0e0-49d8-aba7-d35636f2afc0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:53:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 (non-flash)
Apr 12 00:53:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23431b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2'): ({'sdd'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Removing single pathed devices sdd {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49446d9-0eef-4f02-80d0-09c8612e81c2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ba251-b535-4b6b-8f99-5ada90378d58]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flushing IO for device /dev/sdd {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Deleted allocations for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[85003b27-5b74-4c94-babf-d3bb88e56cd9]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e5ebc-3268-4fb7-b4ef-f1ad326fa5c5]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] SCSI volumes sdd have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60756e5-11a2-41a7-8ce6-c806d9930b89]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb95ca8-7e71-4f2c-a4a2-60027d48a22f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260]
Apr 12 00:53:16 user nova-compute[82394]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2, portal: 172.16.0.220,3260] successful.
Apr 12 00:53:16 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e5c02c-524d-4965-85ea-092f7700dce2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d9c3d-e48c-4b5b-a792-c7ca7a6d39dc]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] <== disconnect_volume: return (303ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:53:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Acquiring lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Lock "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] No waiting events found dispatching network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:53:17 user nova-compute[82394]: WARNING nova.compute.manager [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Received unexpected event network-vif-plugged-203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance with vm_state deleted and task_state None.
Apr 12 00:53:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'flavor' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:53:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:30 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260795.550002, a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:53:30 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] VM Stopped (Lifecycle Event)
Apr 12 00:53:30 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e52d84ce-ee7e-4ef6-8344-92ea46a24c72 None None] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:53:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:39 user nova-compute[82394]: INFO nova.compute.manager [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Terminating instance
Apr 12 00:53:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-unplugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] No waiting events found dispatching network-vif-unplugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:53:39 user nova-compute[82394]: DEBUG nova.compute.manager [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-unplugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Instance destroyed successfully.
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'resources' on Instance uuid 84861eef-6d59-448b-b6b7-eb8dd8e47b30 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1988870830',display_name='tempest-ServerActionsTestJSON-server-1988870830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1988870830',id=34,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ==',key_name='tempest-keypair-1452487550',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:44:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ba626fdf264b879099a89097845153',ramdisk_id='',reservation_id='r-j7kk5no6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-674156571',owner_user_name='tempest-ServerActionsTestJSON-674156571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d658147b4def4d12a16381d4c19357e3',uuid=84861eef-6d59-448b-b6b7-eb8dd8e47b30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converting VIF {"id": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "address": "fa:16:3e:80:83:ee", "network": {"id": "bb566dde-458e-4ead-a04b-6dbdb540007d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-571118926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ba626fdf264b879099a89097845153", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf061f79-75", "ovs_interfaceid": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG os_vif [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf061f79-75, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:40 user nova-compute[82394]: INFO os_vif [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:83:ee,bridge_name='br-int',has_traffic_filtering=True,id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1,network=Network(bb566dde-458e-4ead-a04b-6dbdb540007d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf061f79-75')
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Deleting instance files /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30_del
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Deletion of /opt/stack/data/nova/instances/84861eef-6d59-448b-b6b7-eb8dd8e47b30_del complete
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.compute.manager [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 00:53:40 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Took 0.46 seconds to deallocate network for instance.
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-deleted-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.compute.manager [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Neutron deleted interface df061f79-7574-4b3c-9cf4-2b0e61c5efc1; detaching it from the instance and deleting it from the info cache
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.network.neutron [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Detach interface failed, port_id=df061f79-7574-4b3c-9cf4-2b0e61c5efc1, reason: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:53:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:40 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Deleted allocations for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30
Apr 12 00:53:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.633s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:53:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Acquiring lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:53:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:53:41 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Lock "84861eef-6d59-448b-b6b7-eb8dd8e47b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:53:41 user nova-compute[82394]: DEBUG nova.compute.manager [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] No waiting events found dispatching network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:53:41 user nova-compute[82394]: WARNING nova.compute.manager [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Received unexpected event network-vif-plugged-df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance with vm_state deleted and task_state None.
Apr 12 00:53:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260820.1858342, 84861eef-6d59-448b-b6b7-eb8dd8e47b30 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:53:55 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] VM Stopped (Lifecycle Event)
Apr 12 00:53:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-5ef83d6a-fcdf-427f-bb4d-e2ba42b7e3b0 None None] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:53:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:53:56 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:53:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:54:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:54:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:06 user nova-compute[82394]: INFO nova.compute.manager [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Terminating instance
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-unplugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:54:06 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:06 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=26.341533660888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance a4d163ed-7900-486c-8b96-101af5547580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:54:06 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:07 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Instance destroyed successfully.
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.objects.instance [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'resources' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2121286429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2121286429',id=39,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMokxkK7zF60NPptUZtqbNVO4ee0RHPLQ2WdZtjVQCu24iwsegquteqO8OdbQ9GAUZ1SkIIyk/ht01FuuBU5gCdEaHsQ1JWfdkBxOdNOEqXUd7E1coKER+ZBFRQ3Q9eu5A==',key_name='tempest-keypair-1276421029',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-cmlv5bl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=a4d163ed-7900-486c-8b96-101af5547580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "address": "fa:16:3e:76:3d:f9", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10369c7-25", "ovs_interfaceid": "f10369c7-25e6-4570-86a1-5e9ec3e941be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG os_vif [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10369c7-25, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:07 user nova-compute[82394]: INFO os_vif [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3d:f9,bridge_name='br-int',has_traffic_filtering=True,id=f10369c7-25e6-4570-86a1-5e9ec3e941be,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10369c7-25')
Apr 12 00:54:07 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Deleting instance files /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580_del
Apr 12 00:54:07 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Deletion of /opt/stack/data/nova/instances/a4d163ed-7900-486c-8b96-101af5547580_del complete
Apr 12 00:54:07 user nova-compute[82394]: INFO nova.compute.manager [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 00:54:07 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:54:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:54:08 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] Took 0.98 seconds to deallocate network for instance.
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-deleted-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:08 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Deleted allocations for instance a4d163ed-7900-486c-8b96-101af5547580
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "a4d163ed-7900-486c-8b96-101af5547580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Acquiring lock "a4d163ed-7900-486c-8b96-101af5547580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Lock "a4d163ed-7900-486c-8b96-101af5547580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] No waiting events found dispatching network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:08 user nova-compute[82394]: WARNING nova.compute.manager [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] [instance: a4d163ed-7900-486c-8b96-101af5547580] Received unexpected event network-vif-plugged-f10369c7-25e6-4570-86a1-5e9ec3e941be for instance with vm_state deleted and task_state None.
Apr 12 00:54:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:54:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:54:09 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:09 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:54:18 user nova-compute[82394]: INFO nova.compute.claims [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Claim successful on node user
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:54:18 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:54:18 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Creating image(s)
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "/opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "/opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "/opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG nova.policy [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk 1073741824" returned: 0 in 0.055s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Cannot resize image /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'migration_context' on Instance uuid 33296a29-1e67-414b-b7d7-fa06e688b240 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Ensure instance console log exists: /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Successfully created port: afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Successfully updated port: afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquired lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-changed-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Refreshing instance network info cache due to event network-changed-afefdc63-0a38-4e64-aad6-60392cbd518f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Acquiring lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updating instance_info_cache with network_info: [{"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Releasing lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Instance network_info: |[{"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Acquired lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.neutron [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Refreshing network info cache for port afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Start _get_guest_xml network_info=[{"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:54:20 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:20 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2085542410',display_name='tempest-VolumesActionsTest-instance-2085542410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2085542410',id=40,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-fg42swr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:54:18Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=33296a29-1e67-414b-b7d7-fa06e688b240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'pci_devices' on Instance uuid 33296a29-1e67-414b-b7d7-fa06e688b240 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:54:20 user nova-compute[82394]:   <uuid>33296a29-1e67-414b-b7d7-fa06e688b240</uuid>
Apr 12 00:54:20 user nova-compute[82394]:   <name>instance-00000028</name>
Apr 12 00:54:20 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:54:20 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:54:20 user nova-compute[82394]:   <metadata>
Apr 12 00:54:20 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:54:20 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:name>tempest-VolumesActionsTest-instance-2085542410</nova:name>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:54:20</nova:creationTime>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:54:20 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:54:20 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:owner>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:user uuid="845fc21f48594cb28ac9c770612a1830">tempest-VolumesActionsTest-1257118853-project-member</nova:user>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:project uuid="38c3f0ad11ac49aaaec0a9c1827ddadb">tempest-VolumesActionsTest-1257118853</nova:project>
Apr 12 00:54:20 user nova-compute[82394]:       </nova:owner>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:54:20 user nova-compute[82394]:       <nova:ports>
Apr 12 00:54:20 user nova-compute[82394]:         <nova:port uuid="afefdc63-0a38-4e64-aad6-60392cbd518f">
Apr 12 00:54:20 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 00:54:20 user nova-compute[82394]:         </nova:port>
Apr 12 00:54:20 user nova-compute[82394]:       </nova:ports>
Apr 12 00:54:20 user nova-compute[82394]:     </nova:instance>
Apr 12 00:54:20 user nova-compute[82394]:   </metadata>
Apr 12 00:54:20 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:54:20 user nova-compute[82394]:     <system>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="serial">33296a29-1e67-414b-b7d7-fa06e688b240</entry>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="uuid">33296a29-1e67-414b-b7d7-fa06e688b240</entry>
Apr 12 00:54:20 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:54:20 user nova-compute[82394]:     </system>
Apr 12 00:54:20 user nova-compute[82394]:   </sysinfo>
Apr 12 00:54:20 user nova-compute[82394]:   <os>
Apr 12 00:54:20 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:54:20 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:54:20 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:54:20 user nova-compute[82394]:   </os>
Apr 12 00:54:20 user nova-compute[82394]:   <features>
Apr 12 00:54:20 user nova-compute[82394]:     <acpi/>
Apr 12 00:54:20 user nova-compute[82394]:     <apic/>
Apr 12 00:54:20 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:54:20 user nova-compute[82394]:   </features>
Apr 12 00:54:20 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:54:20 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:54:20 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:54:20 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:54:20 user nova-compute[82394]:   </clock>
Apr 12 00:54:20 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:54:20 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:54:20 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:54:20 user nova-compute[82394]:   </cpu>
Apr 12 00:54:20 user nova-compute[82394]:   <devices>
Apr 12 00:54:20 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:54:20 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:54:20 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk"/>
Apr 12 00:54:20 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:54:20 user nova-compute[82394]:     </disk>
Apr 12 00:54:20 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:54:20 user nova-compute[82394]:       <mac address="fa:16:3e:79:ae:88"/>
Apr 12 00:54:20 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:54:20 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:54:20 user nova-compute[82394]:       <target dev="tapafefdc63-0a"/>
Apr 12 00:54:20 user nova-compute[82394]:     </interface>
Apr 12 00:54:20 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:54:20 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/console.log" append="off"/>
Apr 12 00:54:20 user nova-compute[82394]:     </serial>
Apr 12 00:54:20 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:54:20 user nova-compute[82394]:     <video>
Apr 12 00:54:20 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:54:20 user nova-compute[82394]:     </video>
Apr 12 00:54:20 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:54:20 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:54:20 user nova-compute[82394]:     </rng>
Apr 12 00:54:20 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:54:20 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:54:20 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:54:20 user nova-compute[82394]:     </memballoon>
Apr 12 00:54:20 user nova-compute[82394]:   </devices>
Apr 12 00:54:20 user nova-compute[82394]: </domain>
Apr 12 00:54:20 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2085542410',display_name='tempest-VolumesActionsTest-instance-2085542410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2085542410',id=40,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-fg42swr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:54:18Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=33296a29-1e67-414b-b7d7-fa06e688b240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:54:20 user nova-compute[82394]: DEBUG os_vif [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafefdc63-0a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafefdc63-0a, col_values=(('external_ids', {'iface-id': 'afefdc63-0a38-4e64-aad6-60392cbd518f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:ae:88', 'vm-uuid': '33296a29-1e67-414b-b7d7-fa06e688b240'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:21 user nova-compute[82394]: INFO os_vif [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a')
Apr 12 00:54:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] No VIF found with MAC fa:16:3e:79:ae:88, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updated VIF entry in instance network info cache for port afefdc63-0a38-4e64-aad6-60392cbd518f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updating instance_info_cache with network_info: [{"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:54:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Releasing lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260847.0562356, a4d163ed-7900-486c-8b96-101af5547580 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:54:22 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: a4d163ed-7900-486c-8b96-101af5547580] VM Stopped (Lifecycle Event)
Apr 12 00:54:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c30fa3a6-8c6f-433e-a370-130b1d32d94d None None] [instance: a4d163ed-7900-486c-8b96-101af5547580] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:22 user nova-compute[82394]: WARNING nova.compute.manager [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state building and task_state spawning.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260864.6541283, 33296a29-1e67-414b-b7d7-fa06e688b240 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] VM Resumed (Lifecycle Event)
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Instance spawned successfully.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260864.6559296, 33296a29-1e67-414b-b7d7-fa06e688b240 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] VM Started (Lifecycle Event)
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:24 user nova-compute[82394]: WARNING nova.compute.manager [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state building and task_state spawning.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Took 6.27 seconds to spawn the instance on the hypervisor.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:24 user nova-compute[82394]: INFO nova.compute.manager [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Took 6.80 seconds to build instance.
Apr 12 00:54:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.893s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:54:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:47 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:54:47 user nova-compute[82394]: INFO nova.compute.claims [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Claim successful on node user
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:54:48 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.policy [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:54:48 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Creating image(s)
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk 1073741824" returned: 0 in 0.051s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Cannot resize image /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.objects.instance [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'migration_context' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Ensure instance console log exists: /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:48 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Successfully created port: d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Successfully updated port: d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.compute.manager [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing instance network info cache due to event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:54:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance network_info: |[{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start _get_guest_xml network_info=[{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:54:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-610910613',display_name='tempest-ServerStableDeviceRescueTest-server-610910613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-610910613',id=41,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkaYM4bzvKjlt+XK6hYKnU1Ed3vc/iv6lwsUyEh5UkHRise/0nAsGorrCmpbbpHQeoABf4SqJ+7Cj498V+6EsSu4dT7jtupY55U8ehZ3W+FlZGOucajkyX4bNIKLwnWQ==',key_name='tempest-keypair-1824777377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca08eae6134a639c5f532e0742b3a2',ramdisk_id='',reservation_id='r-ixsey03c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2039136793',owner_user_name='tempest-ServerStableDeviceRescueTest-2039136793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aedb8da82a64bdcaeff07c649f05379',uuid=4a67c354-55e9-4f42-bda3-35d16bf192db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converting VIF {"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:54:50 user nova-compute[82394]:   <uuid>4a67c354-55e9-4f42-bda3-35d16bf192db</uuid>
Apr 12 00:54:50 user nova-compute[82394]:   <name>instance-00000029</name>
Apr 12 00:54:50 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:54:50 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:54:50 user nova-compute[82394]:   <metadata>
Apr 12 00:54:50 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:54:50 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-610910613</nova:name>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:54:50</nova:creationTime>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:54:50 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:54:50 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:owner>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:user uuid="7aedb8da82a64bdcaeff07c649f05379">tempest-ServerStableDeviceRescueTest-2039136793-project-member</nova:user>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:project uuid="21ca08eae6134a639c5f532e0742b3a2">tempest-ServerStableDeviceRescueTest-2039136793</nova:project>
Apr 12 00:54:50 user nova-compute[82394]:       </nova:owner>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:54:50 user nova-compute[82394]:       <nova:ports>
Apr 12 00:54:50 user nova-compute[82394]:         <nova:port uuid="d04a1887-8740-4c6c-a7b6-5e9e395ced98">
Apr 12 00:54:50 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:54:50 user nova-compute[82394]:         </nova:port>
Apr 12 00:54:50 user nova-compute[82394]:       </nova:ports>
Apr 12 00:54:50 user nova-compute[82394]:     </nova:instance>
Apr 12 00:54:50 user nova-compute[82394]:   </metadata>
Apr 12 00:54:50 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:54:50 user nova-compute[82394]:     <system>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="serial">4a67c354-55e9-4f42-bda3-35d16bf192db</entry>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="uuid">4a67c354-55e9-4f42-bda3-35d16bf192db</entry>
Apr 12 00:54:50 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:54:50 user nova-compute[82394]:     </system>
Apr 12 00:54:50 user nova-compute[82394]:   </sysinfo>
Apr 12 00:54:50 user nova-compute[82394]:   <os>
Apr 12 00:54:50 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:54:50 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:54:50 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:54:50 user nova-compute[82394]:   </os>
Apr 12 00:54:50 user nova-compute[82394]:   <features>
Apr 12 00:54:50 user nova-compute[82394]:     <acpi/>
Apr 12 00:54:50 user nova-compute[82394]:     <apic/>
Apr 12 00:54:50 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:54:50 user nova-compute[82394]:   </features>
Apr 12 00:54:50 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:54:50 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:54:50 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:54:50 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:54:50 user nova-compute[82394]:   </clock>
Apr 12 00:54:50 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:54:50 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:54:50 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:54:50 user nova-compute[82394]:   </cpu>
Apr 12 00:54:50 user nova-compute[82394]:   <devices>
Apr 12 00:54:50 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:54:50 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:54:50 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk"/>
Apr 12 00:54:50 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:54:50 user nova-compute[82394]:     </disk>
Apr 12 00:54:50 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:54:50 user nova-compute[82394]:       <mac address="fa:16:3e:27:c9:9e"/>
Apr 12 00:54:50 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:54:50 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:54:50 user nova-compute[82394]:       <target dev="tapd04a1887-87"/>
Apr 12 00:54:50 user nova-compute[82394]:     </interface>
Apr 12 00:54:50 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:54:50 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/console.log" append="off"/>
Apr 12 00:54:50 user nova-compute[82394]:     </serial>
Apr 12 00:54:50 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:54:50 user nova-compute[82394]:     <video>
Apr 12 00:54:50 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:54:50 user nova-compute[82394]:     </video>
Apr 12 00:54:50 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:54:50 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:54:50 user nova-compute[82394]:     </rng>
Apr 12 00:54:50 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:54:50 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:54:50 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:54:50 user nova-compute[82394]:     </memballoon>
Apr 12 00:54:50 user nova-compute[82394]:   </devices>
Apr 12 00:54:50 user nova-compute[82394]: </domain>
Apr 12 00:54:50 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-610910613',display_name='tempest-ServerStableDeviceRescueTest-server-610910613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-610910613',id=41,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkaYM4bzvKjlt+XK6hYKnU1Ed3vc/iv6lwsUyEh5UkHRise/0nAsGorrCmpbbpHQeoABf4SqJ+7Cj498V+6EsSu4dT7jtupY55U8ehZ3W+FlZGOucajkyX4bNIKLwnWQ==',key_name='tempest-keypair-1824777377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca08eae6134a639c5f532e0742b3a2',ramdisk_id='',reservation_id='r-ixsey03c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2039136793',owner_user_name='tempest-ServerStableDeviceRescueTest-2039136793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aedb8da82a64bdcaeff07c649f05379',uuid=4a67c354-55e9-4f42-bda3-35d16bf192db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converting VIF {"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG os_vif [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd04a1887-87, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd04a1887-87, col_values=(('external_ids', {'iface-id': 'd04a1887-8740-4c6c-a7b6-5e9e395ced98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c9:9e', 'vm-uuid': '4a67c354-55e9-4f42-bda3-35d16bf192db'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:50 user nova-compute[82394]: INFO os_vif [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87')
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No VIF found with MAC fa:16:3e:27:c9:9e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated VIF entry in instance network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:54:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:51 user nova-compute[82394]: WARNING nova.compute.manager [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state building and task_state spawning.
Apr 12 00:54:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260893.664498, 4a67c354-55e9-4f42-bda3-35d16bf192db => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Resumed (Lifecycle Event)
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance spawned successfully.
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260893.6660714, 4a67c354-55e9-4f42-bda3-35d16bf192db => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Started (Lifecycle Event)
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:54:53 user nova-compute[82394]: WARNING nova.compute.manager [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state building and task_state spawning.
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 12 00:54:53 user nova-compute[82394]: DEBUG nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:54:53 user nova-compute[82394]: INFO nova.compute.manager [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Took 6.04 seconds to build instance.
Apr 12 00:54:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.145s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:54:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:54:57 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:54:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:54:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:55:00 user nova-compute[82394]: INFO nova.compute.claims [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Claim successful on node user
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:55:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.policy [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:55:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Creating image(s)
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk 1073741824" returned: 0 in 0.066s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Cannot resize image /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'migration_context' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Ensure instance console log exists: /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Successfully created port: 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Successfully updated port: 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing instance network info cache due to event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:55:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance network_info: |[{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start _get_guest_xml network_info=[{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:55:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:55:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Wdo8lz+ZAHRli9jiADK4Sk7Y/NTuUS3pMEJzsy5L3/rQRehuzFZ0WTvUKDg92fAHcsMVP1vVTwrU696XzeqdiIx5fwn9f1xYz3ikBKgpnr3tCLjlykBzcNLc0GQnnbg==',key_name='tempest-keypair-238651399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:55:02 user nova-compute[82394]:   <uuid>4e24bbae-7697-4c46-9c68-48d8393da608</uuid>
Apr 12 00:55:02 user nova-compute[82394]:   <name>instance-0000002a</name>
Apr 12 00:55:02 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:55:02 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:55:02 user nova-compute[82394]:   <metadata>
Apr 12 00:55:02 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:55:02 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1629541624</nova:name>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:55:02</nova:creationTime>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:55:02 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:55:02 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:owner>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:user uuid="418881a7e56e4c19bbf900ef71029ce0">tempest-AttachVolumeShelveTestJSON-1335687803-project-member</nova:user>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:project uuid="c26d891933d647b7b27c75915fb726f3">tempest-AttachVolumeShelveTestJSON-1335687803</nova:project>
Apr 12 00:55:02 user nova-compute[82394]:       </nova:owner>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:55:02 user nova-compute[82394]:       <nova:ports>
Apr 12 00:55:02 user nova-compute[82394]:         <nova:port uuid="6c9e7810-9a63-4360-889c-edbd6af6ba4f">
Apr 12 00:55:02 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 00:55:02 user nova-compute[82394]:         </nova:port>
Apr 12 00:55:02 user nova-compute[82394]:       </nova:ports>
Apr 12 00:55:02 user nova-compute[82394]:     </nova:instance>
Apr 12 00:55:02 user nova-compute[82394]:   </metadata>
Apr 12 00:55:02 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:55:02 user nova-compute[82394]:     <system>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="serial">4e24bbae-7697-4c46-9c68-48d8393da608</entry>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="uuid">4e24bbae-7697-4c46-9c68-48d8393da608</entry>
Apr 12 00:55:02 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:55:02 user nova-compute[82394]:     </system>
Apr 12 00:55:02 user nova-compute[82394]:   </sysinfo>
Apr 12 00:55:02 user nova-compute[82394]:   <os>
Apr 12 00:55:02 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:55:02 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:55:02 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:55:02 user nova-compute[82394]:   </os>
Apr 12 00:55:02 user nova-compute[82394]:   <features>
Apr 12 00:55:02 user nova-compute[82394]:     <acpi/>
Apr 12 00:55:02 user nova-compute[82394]:     <apic/>
Apr 12 00:55:02 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:55:02 user nova-compute[82394]:   </features>
Apr 12 00:55:02 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:55:02 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:55:02 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:55:02 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:55:02 user nova-compute[82394]:   </clock>
Apr 12 00:55:02 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:55:02 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:55:02 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:55:02 user nova-compute[82394]:   </cpu>
Apr 12 00:55:02 user nova-compute[82394]:   <devices>
Apr 12 00:55:02 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:55:02 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:55:02 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk"/>
Apr 12 00:55:02 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:55:02 user nova-compute[82394]:     </disk>
Apr 12 00:55:02 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:55:02 user nova-compute[82394]:       <mac address="fa:16:3e:e2:1d:5b"/>
Apr 12 00:55:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:55:02 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:55:02 user nova-compute[82394]:       <target dev="tap6c9e7810-9a"/>
Apr 12 00:55:02 user nova-compute[82394]:     </interface>
Apr 12 00:55:02 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:55:02 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/console.log" append="off"/>
Apr 12 00:55:02 user nova-compute[82394]:     </serial>
Apr 12 00:55:02 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:55:02 user nova-compute[82394]:     <video>
Apr 12 00:55:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:55:02 user nova-compute[82394]:     </video>
Apr 12 00:55:02 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:55:02 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:55:02 user nova-compute[82394]:     </rng>
Apr 12 00:55:02 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:55:02 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:55:02 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:55:02 user nova-compute[82394]:     </memballoon>
Apr 12 00:55:02 user nova-compute[82394]:   </devices>
Apr 12 00:55:02 user nova-compute[82394]: </domain>
Apr 12 00:55:02 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Wdo8lz+ZAHRli9jiADK4Sk7Y/NTuUS3pMEJzsy5L3/rQRehuzFZ0WTvUKDg92fAHcsMVP1vVTwrU696XzeqdiIx5fwn9f1xYz3ikBKgpnr3tCLjlykBzcNLc0GQnnbg==',key_name='tempest-keypair-238651399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG os_vif [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9e7810-9a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9e7810-9a, col_values=(('external_ids', {'iface-id': '6c9e7810-9a63-4360-889c-edbd6af6ba4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:1d:5b', 'vm-uuid': '4e24bbae-7697-4c46-9c68-48d8393da608'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:02 user nova-compute[82394]: INFO os_vif [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a')
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No VIF found with MAC fa:16:3e:e2:1d:5b, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updated VIF entry in instance network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:55:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:55:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:55:04 user nova-compute[82394]: WARNING nova.compute.manager [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state building and task_state spawning.
Apr 12 00:55:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260905.795085, 4e24bbae-7697-4c46-9c68-48d8393da608 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Resumed (Lifecycle Event)
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance spawned successfully.
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681260905.7992897, 4e24bbae-7697-4c46-9c68-48d8393da608 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Started (Lifecycle Event)
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:55:05 user nova-compute[82394]: INFO nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 12 00:55:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:55:06 user nova-compute[82394]: INFO nova.compute.manager [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Took 5.96 seconds to build instance.
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.054s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:55:06 user nova-compute[82394]: WARNING nova.compute.manager [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state active and task_state None.
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:55:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:55:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:55:08 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:55:08 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=26.317428588867188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 33296a29-1e67-414b-b7d7-fa06e688b240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4e24bbae-7697-4c46-9c68-48d8393da608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:55:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 33296a29-1e67-414b-b7d7-fa06e688b240 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:55:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:11 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updating instance_info_cache with network_info: [{"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:55:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-33296a29-1e67-414b-b7d7-fa06e688b240" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:55:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:55:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:55:58 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:55:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:01 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:56:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:56:07 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:08 user nova-compute[82394]: INFO nova.compute.manager [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Terminating instance
Apr 12 00:56:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:08 user nova-compute[82394]: DEBUG nova.compute.manager [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:09 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:56:09 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=26.29700469970703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:09 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Instance destroyed successfully.
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.objects.instance [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'resources' on Instance uuid 33296a29-1e67-414b-b7d7-fa06e688b240 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2085542410',display_name='tempest-VolumesActionsTest-instance-2085542410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2085542410',id=40,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-fg42swr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:54:25Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=33296a29-1e67-414b-b7d7-fa06e688b240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "afefdc63-0a38-4e64-aad6-60392cbd518f", "address": "fa:16:3e:79:ae:88", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafefdc63-0a", "ovs_interfaceid": "afefdc63-0a38-4e64-aad6-60392cbd518f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG os_vif [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafefdc63-0a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:56:09 user nova-compute[82394]: INFO os_vif [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=afefdc63-0a38-4e64-aad6-60392cbd518f,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafefdc63-0a')
Apr 12 00:56:09 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Deleting instance files /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240_del
Apr 12 00:56:09 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Deletion of /opt/stack/data/nova/instances/33296a29-1e67-414b-b7d7-fa06e688b240_del complete
Apr 12 00:56:09 user nova-compute[82394]: INFO nova.compute.manager [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 00:56:09 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 33296a29-1e67-414b-b7d7-fa06e688b240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4e24bbae-7697-4c46-9c68-48d8393da608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:56:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:10 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Took 0.79 seconds to deallocate network for instance.
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-deleted-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Deleted allocations for instance 33296a29-1e67-414b-b7d7-fa06e688b240
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "33296a29-1e67-414b-b7d7-fa06e688b240" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:10 user nova-compute[82394]: WARNING nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state deleted and task_state None.
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:10 user nova-compute[82394]: WARNING nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state deleted and task_state None.
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:10 user nova-compute[82394]: WARNING nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state deleted and task_state None.
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:10 user nova-compute[82394]: WARNING nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-unplugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state deleted and task_state None.
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "33296a29-1e67-414b-b7d7-fa06e688b240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] No waiting events found dispatching network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:10 user nova-compute[82394]: WARNING nova.compute.manager [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Received unexpected event network-vif-plugged-afefdc63-0a38-4e64-aad6-60392cbd518f for instance with vm_state deleted and task_state None.
Apr 12 00:56:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:56:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:14 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 00:56:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 00:56:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:24 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681260969.1893013, 33296a29-1e67-414b-b7d7-fa06e688b240 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:56:24 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] VM Stopped (Lifecycle Event)
Apr 12 00:56:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-52fcf463-40c6-4301-975c-bdc1457661a9 None None] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:56:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:56:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:56:31 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:33 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 00:56:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing instance network info cache due to event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:56:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:56:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:56:38 user nova-compute[82394]: DEBUG nova.network.neutron [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG nova.network.neutron [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated VIF entry in instance network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG nova.network.neutron [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:39 user nova-compute[82394]: DEBUG nova.compute.manager [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:56:39 user nova-compute[82394]: INFO nova.compute.manager [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] instance snapshotting
Apr 12 00:56:39 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Beginning live snapshot process
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json -f qcow2 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7.delta 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:40 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7.delta 1073741824" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 00:56:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:56:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82394) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 00:56:41 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 00:56:41 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:56:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7.delta /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7.delta /opt/stack/data/nova/instances/snapshots/tmp1o_u0668/721e79741eb44fd0b45feab0791418e7" returned: 0 in 0.557s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:42 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Snapshot extracted, beginning image upload
Apr 12 00:56:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:44 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Snapshot image upload complete
Apr 12 00:56:44 user nova-compute[82394]: INFO nova.compute.manager [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Took 4.70 seconds to snapshot the instance on the hypervisor.
Apr 12 00:56:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG nova.compute.manager [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing instance network info cache due to event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updated VIF entry in instance network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:53 user nova-compute[82394]: INFO nova.compute.manager [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Shelving
Apr 12 00:56:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:53 user nova-compute[82394]: WARNING nova.compute.manager [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state active and task_state shelving.
Apr 12 00:56:53 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance destroyed successfully.
Apr 12 00:56:54 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Beginning cold snapshot process
Apr 12 00:56:54 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:56:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk /opt/stack/data/nova/instances/snapshots/tmp9_tg8d_b/da402e5e72694310897c5fbd55f75129 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:56:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:54 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk /opt/stack/data/nova/instances/snapshots/tmp9_tg8d_b/da402e5e72694310897c5fbd55f75129" returned: 0 in 0.462s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:56:54 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Snapshot extracted, beginning image upload
Apr 12 00:56:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:55 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:55 user nova-compute[82394]: DEBUG nova.compute.manager [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:56:55 user nova-compute[82394]: WARNING nova.compute.manager [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 00:56:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Snapshot image upload complete
Apr 12 00:56:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:56:56 user nova-compute[82394]: INFO nova.compute.manager [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Shelve offloading
Apr 12 00:56:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance destroyed successfully.
Apr 12 00:56:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:56:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:56:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:56:56 user nova-compute[82394]: DEBUG nova.network.neutron [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.network.neutron [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:56:57 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance destroyed successfully.
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.objects.instance [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'resources' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Wdo8lz+ZAHRli9jiADK4Sk7Y/NTuUS3pMEJzsy5L3/rQRehuzFZ0WTvUKDg92fAHcsMVP1vVTwrU696XzeqdiIx5fwn9f1xYz3ikBKgpnr3tCLjlykBzcNLc0GQnnbg==',key_name='tempest-keypair-238651399',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:56:56.851220',shelved_host='user',shelved_image_id='f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG os_vif [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9e7810-9a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.compute.manager [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing instance network info cache due to event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG nova.network.neutron [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:56:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:56:57 user nova-compute[82394]: INFO os_vif [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a')
Apr 12 00:56:57 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Deleting instance files /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608_del
Apr 12 00:56:57 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Deletion of /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608_del complete
Apr 12 00:56:58 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Deleted allocations for instance 4e24bbae-7697-4c46-9c68-48d8393da608
Apr 12 00:56:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG nova.objects.instance [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 4.956s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updated VIF entry in instance network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG nova.network.neutron [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:56:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:56:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:56:59 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:57:00 user nova-compute[82394]: INFO nova.compute.claims [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Claim successful on node user
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 00:57:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:57:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Creating image(s)
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "/opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "/opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.policy [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk 1073741824" returned: 0 in 0.047s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 00:57:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Cannot resize image /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'migration_context' on Instance uuid 2c15d2ee-f758-414a-8167-aa95c17e60aa {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Ensure instance console log exists: /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Successfully created port: eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Successfully updated port: eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquired lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-changed-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.compute.manager [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Refreshing instance network info cache due to event network-changed-eb075efa-9c5e-44db-b287-8172cee0658b. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Acquiring lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Updating instance_info_cache with network_info: [{"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Releasing lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Instance network_info: |[{"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Acquired lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Refreshing network info cache for port eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Start _get_guest_xml network_info=[{"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:57:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:57:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-148486663',display_name='tempest-VolumesActionsTest-instance-148486663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-148486663',id=43,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-0f93xipm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:57:00Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=2c15d2ee-f758-414a-8167-aa95c17e60aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c15d2ee-f758-414a-8167-aa95c17e60aa {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:57:02 user nova-compute[82394]:   <uuid>2c15d2ee-f758-414a-8167-aa95c17e60aa</uuid>
Apr 12 00:57:02 user nova-compute[82394]:   <name>instance-0000002b</name>
Apr 12 00:57:02 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:57:02 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:57:02 user nova-compute[82394]:   <metadata>
Apr 12 00:57:02 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:57:02 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:name>tempest-VolumesActionsTest-instance-148486663</nova:name>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:57:02</nova:creationTime>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:57:02 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:57:02 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:owner>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:user uuid="845fc21f48594cb28ac9c770612a1830">tempest-VolumesActionsTest-1257118853-project-member</nova:user>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:project uuid="38c3f0ad11ac49aaaec0a9c1827ddadb">tempest-VolumesActionsTest-1257118853</nova:project>
Apr 12 00:57:02 user nova-compute[82394]:       </nova:owner>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:57:02 user nova-compute[82394]:       <nova:ports>
Apr 12 00:57:02 user nova-compute[82394]:         <nova:port uuid="eb075efa-9c5e-44db-b287-8172cee0658b">
Apr 12 00:57:02 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 00:57:02 user nova-compute[82394]:         </nova:port>
Apr 12 00:57:02 user nova-compute[82394]:       </nova:ports>
Apr 12 00:57:02 user nova-compute[82394]:     </nova:instance>
Apr 12 00:57:02 user nova-compute[82394]:   </metadata>
Apr 12 00:57:02 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:57:02 user nova-compute[82394]:     <system>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="serial">2c15d2ee-f758-414a-8167-aa95c17e60aa</entry>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="uuid">2c15d2ee-f758-414a-8167-aa95c17e60aa</entry>
Apr 12 00:57:02 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:57:02 user nova-compute[82394]:     </system>
Apr 12 00:57:02 user nova-compute[82394]:   </sysinfo>
Apr 12 00:57:02 user nova-compute[82394]:   <os>
Apr 12 00:57:02 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:57:02 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:57:02 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:57:02 user nova-compute[82394]:   </os>
Apr 12 00:57:02 user nova-compute[82394]:   <features>
Apr 12 00:57:02 user nova-compute[82394]:     <acpi/>
Apr 12 00:57:02 user nova-compute[82394]:     <apic/>
Apr 12 00:57:02 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:57:02 user nova-compute[82394]:   </features>
Apr 12 00:57:02 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:57:02 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:57:02 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:57:02 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:57:02 user nova-compute[82394]:   </clock>
Apr 12 00:57:02 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:57:02 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:57:02 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:57:02 user nova-compute[82394]:   </cpu>
Apr 12 00:57:02 user nova-compute[82394]:   <devices>
Apr 12 00:57:02 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:57:02 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:57:02 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk"/>
Apr 12 00:57:02 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:57:02 user nova-compute[82394]:     </disk>
Apr 12 00:57:02 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:57:02 user nova-compute[82394]:       <mac address="fa:16:3e:8c:4d:b7"/>
Apr 12 00:57:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:57:02 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:57:02 user nova-compute[82394]:       <target dev="tapeb075efa-9c"/>
Apr 12 00:57:02 user nova-compute[82394]:     </interface>
Apr 12 00:57:02 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:57:02 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/console.log" append="off"/>
Apr 12 00:57:02 user nova-compute[82394]:     </serial>
Apr 12 00:57:02 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:57:02 user nova-compute[82394]:     <video>
Apr 12 00:57:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:57:02 user nova-compute[82394]:     </video>
Apr 12 00:57:02 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:57:02 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:57:02 user nova-compute[82394]:     </rng>
Apr 12 00:57:02 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:57:02 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:57:02 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:57:02 user nova-compute[82394]:     </memballoon>
Apr 12 00:57:02 user nova-compute[82394]:   </devices>
Apr 12 00:57:02 user nova-compute[82394]: </domain>
Apr 12 00:57:02 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-148486663',display_name='tempest-VolumesActionsTest-instance-148486663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-148486663',id=43,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-0f93xipm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:57:00Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=2c15d2ee-f758-414a-8167-aa95c17e60aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG os_vif [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb075efa-9c, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb075efa-9c, col_values=(('external_ids', {'iface-id': 'eb075efa-9c5e-44db-b287-8172cee0658b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:4d:b7', 'vm-uuid': '2c15d2ee-f758-414a-8167-aa95c17e60aa'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:02 user nova-compute[82394]: INFO os_vif [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c')
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] No VIF found with MAC fa:16:3e:8c:4d:b7, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Updated VIF entry in instance network info cache for port eb075efa-9c5e-44db-b287-8172cee0658b. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG nova.network.neutron [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Updating instance_info_cache with network_info: [{"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Releasing lock "refresh_cache-2c15d2ee-f758-414a-8167-aa95c17e60aa" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:57:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:04 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:04 user nova-compute[82394]: DEBUG nova.compute.manager [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:57:04 user nova-compute[82394]: WARNING nova.compute.manager [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state building and task_state spawning.
Apr 12 00:57:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261026.0709171, 2c15d2ee-f758-414a-8167-aa95c17e60aa => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] VM Resumed (Lifecycle Event)
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Instance spawned successfully.
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261026.0726147, 2c15d2ee-f758-414a-8167-aa95c17e60aa => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] VM Started (Lifecycle Event)
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:57:06 user nova-compute[82394]: WARNING nova.compute.manager [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state building and task_state spawning.
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 12 00:57:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:57:06 user nova-compute[82394]: INFO nova.compute.manager [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Took 6.17 seconds to build instance.
Apr 12 00:57:06 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.262s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:08 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261013.9457579, 4e24bbae-7697-4c46-9c68-48d8393da608 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:57:08 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Stopped (Lifecycle Event)
Apr 12 00:57:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e80bfbea-f261-403c-a9cd-2961db17c785 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:57:09 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:57:09 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:57:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=26.26064682006836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Skipping network cache update for instance because it has been migrated to another host. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 2c15d2ee-f758-414a-8167-aa95c17e60aa {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:57:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:03 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:58:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:58:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:10 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=26.241661071777344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:58:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 00:58:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:58:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'flavor' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:32 user nova-compute[82394]: INFO nova.compute.manager [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attaching volume e40b29b9-23d9-4c1e-88f1-f95983dbe508 to /dev/vdb
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.utils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ad10ea-eec5-45b5-b112-61f33676258c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acdd094-f507-4f91-baf4-56133aaa3bf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f975271-e722-4145-b615-fd82e5d4c598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed3de9-2f9e-417c-b91a-977ec8b49da7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 00:58:32 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 00:58:32 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f501fb-ada1-4c1a-9f4a-27b433223a6f]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG os_brick.utils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:58:32 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating existing volume attachment record: 960adcf8-04c4-4502-add7-015a51ab866f {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:58:36 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:58:36 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:58:36 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6945f49-59de-4f77-9c19-7819c445c748]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 00:58:36 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dea129-b15b-4a95-a7ab-aa4f8e9f1864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508] added
Apr 12 00:58:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed59dbe-55fb-4724-ba37-03b71870de40]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4394df-ae36-42e6-af93-c66b0205bb8a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNORPZAJ {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNORPZAJ" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73216204-bc39-4991-a96b-158fd096f257]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNORPZAJ'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace53f8-b833-49a8-828e-53890e2f8855]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb6aaa-0acd-4394-b853-059b6c642d5b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:58:36 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 00:58:36 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:58:36 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 00:58:36 user nova-compute[82394]: 
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeac722-cdf8-4c7b-8c9b-64d49da9046c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260]
Apr 12 00:58:36 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260] successful.
Apr 12 00:58:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cef626-8364-45c9-a162-47266501891b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544297c-311c-494b-b74a-78b48932b661]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 00:58:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 00:58:36 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abde7b6-776f-4fe5-b5cf-4c061cefeafe]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:58:36 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23761663165666633', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761663165666633', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG nova.objects.instance [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'flavor' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 00:58:37 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:58:37 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 00:58:37 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 00:58:37 user nova-compute[82394]:   <serial>e40b29b9-23d9-4c1e-88f1-f95983dbe508</serial>
Apr 12 00:58:37 user nova-compute[82394]: </disk>
Apr 12 00:58:37 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 00:58:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No VIF found with MAC fa:16:3e:27:c9:9e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:58:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.257s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:39 user nova-compute[82394]: INFO nova.compute.manager [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Rescuing
Apr 12 00:58:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG nova.network.neutron [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG nova.compute.manager [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:40 user nova-compute[82394]: WARNING nova.compute.manager [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state active and task_state rescuing.
Apr 12 00:58:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance destroyed successfully.
Apr 12 00:58:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attempting a stable device rescue
Apr 12 00:58:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82394) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance directory exists: not creating {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 00:58:40 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Creating image(s)
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "d45be03e1049ac760afe31ef3aa68b688f378bda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "d45be03e1049ac760afe31ef3aa68b688f378bda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.part --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:41 user nova-compute[82394]: DEBUG nova.virt.images [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] dfe86d03-a733-4f19-9cc7-56074698a841 was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:58:41 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:58:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.part /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.compute.manager [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:42 user nova-compute[82394]: WARNING nova.compute.manager [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state active and task_state rescuing.
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.part /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.converted" returned: 0 in 0.614s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "d45be03e1049ac760afe31ef3aa68b688f378bda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.703s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "d45be03e1049ac760afe31ef3aa68b688f378bda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "d45be03e1049ac760afe31ef3aa68b688f378bda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda --force-share --output=json" returned: 0 in 0.129s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda,backing_fmt=raw /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda,backing_fmt=raw /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "d45be03e1049ac760afe31ef3aa68b688f378bda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'migration_context' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start _get_guest_xml network_info=[{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "vif_mac": "fa:16:3e:27:c9:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dfe86d03-a733-4f19-9cc7-56074698a841', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '960adcf8-04c4-4502-add7-015a51ab866f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4a67c354-55e9-4f42-bda3-35d16bf192db', 'attached_at': '', 'detached_at': '', 'volume_id': 'e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'serial': 'e40b29b9-23d9-4c1e-88f1-f95983dbe508'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'resources' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:42 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 00:58:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:58:42 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 00:58:42 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfeaf3a-1fd0-4170-9359-78ba9fbdfc68]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dNORPZAJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 00:58:42 user nova-compute[82394]: node.name = iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508
Apr 12 00:58:42 user nova-compute[82394]: node.tpgt = -1
Apr 12 00:58:42 user nova-compute[82394]: node.startup = automatic
Apr 12 00:58:42 user nova-compute[82394]: node.leading_login = No
Apr 12 00:58:42 user nova-compute[82394]: iface.iscsi_ifacename = default
Apr 12 00:58:42 user nova-compute[82394]: iface.net_ifacename = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.ipaddress = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.prefix_len = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.hwaddress = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.transport_name = tcp
Apr 12 00:58:42 user nova-compute[82394]: iface.initiatorname = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.vlan_id = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.vlan_priority = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.vlan_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.iface_num = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.mtu = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.port = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.bootproto = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.subnet_mask = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.gateway = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_alt_client_id = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_dns = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_learn_iqn = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_vendor_id_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_vendor_id = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.dhcp_slp_da = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.fragmentation = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.gratuitous_arp = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.incoming_forwarding = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.tos_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.tos = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.ttl = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.delayed_ack = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.tcp_nagle = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.tcp_wsf_state = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.tcp_wsf = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.tcp_timer_scale = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.tcp_timestamp = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.redirect = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.def_task_mgmt_timeout = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.header_digest = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.data_digest = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.immediate_data = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.initial_r2t = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.data_seq_inorder = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.data_pdu_inorder = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.erl = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.max_receive_data_len = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.first_burst_len = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.max_outstanding_r2t = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.max_burst_len = 0
Apr 12 00:58:42 user nova-compute[82394]: iface.chap_auth = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.bidi_chap = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.strict_login_compliance = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.discovery_auth = <empty>
Apr 12 00:58:42 user nova-compute[82394]: iface.discovery_logout = <empty>
Apr 12 00:58:42 user nova-compute[82394]: node.discovery_address = <empty>
Apr 12 00:58:42 user nova-compute[82394]: node.discovery_port = 0
Apr 12 00:58:42 user nova-compute[82394]: node.discovery_type = static
Apr 12 00:58:42 user nova-compute[82394]: node.session.initial_cmdsn = 0
Apr 12 00:58:42 user nova-compute[82394]: node.session.initial_login_retry_max = 8
Apr 12 00:58:42 user nova-compute[82394]: node.session.xmit_thread_priority = -20
Apr 12 00:58:42 user nova-compute[82394]: node.session.cmds_max = 128
Apr 12 00:58:42 user nova-compute[82394]: node.session.queue_depth = 32
Apr 12 00:58:42 user nova-compute[82394]: node.session.nr_sessions = 1
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.authmethod = CHAP
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.username = dNORPZAJ
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.password = ***
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.username_in = <empty>
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.password_in = <empty>
Apr 12 00:58:42 user nova-compute[82394]: node.session.auth.chap_algs = MD5
Apr 12 00:58:42 user nova-compute[82394]: node.session.timeo.replacement_timeout = 120
Apr 12 00:58:42 user nova-compute[82394]: node.session.err_timeo.abort_timeout = 15
Apr 12 00:58:42 user nova-compute[82394]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 00:58:42 user nova-compute[82394]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 00:58:42 user nova-compute[82394]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.FastAbort = Yes
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.InitialR2T = No
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.ImmediateData = Yes
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.MaxConnections = 1
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 00:58:42 user nova-compute[82394]: node.session.iscsi.ERL = 0
Apr 12 00:58:42 user nova-compute[82394]: node.session.scan = manual
Apr 12 00:58:42 user nova-compute[82394]: node.session.reopen_max = 0
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].address = 172.16.0.220
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].port = 3260
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].startup = manual
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].tcp.window_size = 524288
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].tcp.type_of_service = 0
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].timeo.logout_timeout = 15
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].timeo.login_timeout = 15
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].timeo.auth_timeout = 45
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.DataDigest = None
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.IFMarker = No
Apr 12 00:58:42 user nova-compute[82394]: node.conn[0].iscsi.OFMarker = No
Apr 12 00:58:42 user nova-compute[82394]: # END RECORD
Apr 12 00:58:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaf8edd-a125-494a-8e6b-c6cad49dcdaf]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975d204-cca9-46ae-b095-92c39a690c92]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNORPZAJ {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNORPZAJ" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5b572-1c57-4a5f-b8a9-3ebe7395d993]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNORPZAJ'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39472af2-0ecf-47f4-81eb-614637b5b69d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4baa02-ffc8-4828-9210-cd19f6ec7e59]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 00:58:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 00:58:42 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] HCTL ('33', '0', '0', 0) found on session 46 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b805040-7905-4270-a8f1-ff720df8dab4]: (4, ('0 0 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Searching for a device in session 46 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23761663165666633', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761663165666633', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-610910613',display_name='tempest-ServerStableDeviceRescueTest-server-610910613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-610910613',id=41,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkaYM4bzvKjlt+XK6hYKnU1Ed3vc/iv6lwsUyEh5UkHRise/0nAsGorrCmpbbpHQeoABf4SqJ+7Cj498V+6EsSu4dT7jtupY55U8ehZ3W+FlZGOucajkyX4bNIKLwnWQ==',key_name='tempest-keypair-1824777377',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21ca08eae6134a639c5f532e0742b3a2',ramdisk_id='',reservation_id='r-ixsey03c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2039136793',owner_user_name='tempest-ServerStableDeviceRescueTest-2039136793-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aedb8da82a64bdcaeff07c649f05379',uuid=4a67c354-55e9-4f42-bda3-35d16bf192db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "vif_mac": "fa:16:3e:27:c9:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converting VIF {"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "vif_mac": "fa:16:3e:27:c9:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:42 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:58:42 user nova-compute[82394]:   <uuid>4a67c354-55e9-4f42-bda3-35d16bf192db</uuid>
Apr 12 00:58:42 user nova-compute[82394]:   <name>instance-00000029</name>
Apr 12 00:58:42 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:58:42 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:58:42 user nova-compute[82394]:   <metadata>
Apr 12 00:58:42 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:58:42 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-610910613</nova:name>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:58:42</nova:creationTime>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:58:42 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:58:42 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:owner>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:user uuid="7aedb8da82a64bdcaeff07c649f05379">tempest-ServerStableDeviceRescueTest-2039136793-project-member</nova:user>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:project uuid="21ca08eae6134a639c5f532e0742b3a2">tempest-ServerStableDeviceRescueTest-2039136793</nova:project>
Apr 12 00:58:42 user nova-compute[82394]:       </nova:owner>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 00:58:42 user nova-compute[82394]:       <nova:ports>
Apr 12 00:58:42 user nova-compute[82394]:         <nova:port uuid="d04a1887-8740-4c6c-a7b6-5e9e395ced98">
Apr 12 00:58:42 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 00:58:42 user nova-compute[82394]:         </nova:port>
Apr 12 00:58:42 user nova-compute[82394]:       </nova:ports>
Apr 12 00:58:42 user nova-compute[82394]:     </nova:instance>
Apr 12 00:58:42 user nova-compute[82394]:   </metadata>
Apr 12 00:58:42 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:58:42 user nova-compute[82394]:     <system>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="serial">4a67c354-55e9-4f42-bda3-35d16bf192db</entry>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="uuid">4a67c354-55e9-4f42-bda3-35d16bf192db</entry>
Apr 12 00:58:42 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:58:42 user nova-compute[82394]:     </system>
Apr 12 00:58:42 user nova-compute[82394]:   </sysinfo>
Apr 12 00:58:42 user nova-compute[82394]:   <os>
Apr 12 00:58:42 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:58:42 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:58:42 user nova-compute[82394]:   </os>
Apr 12 00:58:42 user nova-compute[82394]:   <features>
Apr 12 00:58:42 user nova-compute[82394]:     <acpi/>
Apr 12 00:58:42 user nova-compute[82394]:     <apic/>
Apr 12 00:58:42 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:58:42 user nova-compute[82394]:   </features>
Apr 12 00:58:42 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:58:42 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:58:42 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:58:42 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:58:42 user nova-compute[82394]:   </clock>
Apr 12 00:58:42 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:58:42 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:58:42 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:58:42 user nova-compute[82394]:   </cpu>
Apr 12 00:58:42 user nova-compute[82394]:   <devices>
Apr 12 00:58:42 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:58:42 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:58:42 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk"/>
Apr 12 00:58:42 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:58:42 user nova-compute[82394]:     </disk>
Apr 12 00:58:42 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 00:58:42 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 00:58:42 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 00:58:42 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 00:58:42 user nova-compute[82394]:       <serial>e40b29b9-23d9-4c1e-88f1-f95983dbe508</serial>
Apr 12 00:58:42 user nova-compute[82394]:     </disk>
Apr 12 00:58:42 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:58:42 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:58:42 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue"/>
Apr 12 00:58:42 user nova-compute[82394]:       <target dev="vdc" bus="virtio"/>
Apr 12 00:58:42 user nova-compute[82394]:       <boot order="1"/>
Apr 12 00:58:42 user nova-compute[82394]:     </disk>
Apr 12 00:58:42 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:58:42 user nova-compute[82394]:       <mac address="fa:16:3e:27:c9:9e"/>
Apr 12 00:58:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:58:42 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:58:42 user nova-compute[82394]:       <target dev="tapd04a1887-87"/>
Apr 12 00:58:42 user nova-compute[82394]:     </interface>
Apr 12 00:58:42 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:58:42 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/console.log" append="off"/>
Apr 12 00:58:42 user nova-compute[82394]:     </serial>
Apr 12 00:58:42 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:58:42 user nova-compute[82394]:     <video>
Apr 12 00:58:42 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:58:42 user nova-compute[82394]:     </video>
Apr 12 00:58:42 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:58:42 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:58:42 user nova-compute[82394]:     </rng>
Apr 12 00:58:42 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:58:42 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:58:42 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:58:42 user nova-compute[82394]:     </memballoon>
Apr 12 00:58:42 user nova-compute[82394]:   </devices>
Apr 12 00:58:42 user nova-compute[82394]: </domain>
Apr 12 00:58:42 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:58:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance destroyed successfully.
Apr 12 00:58:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:43 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] No VIF found with MAC fa:16:3e:27:c9:9e, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:44 user nova-compute[82394]: DEBUG nova.compute.manager [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:44 user nova-compute[82394]: WARNING nova.compute.manager [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state active and task_state rescuing.
Apr 12 00:58:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:45 user nova-compute[82394]: INFO nova.compute.manager [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Unshelving
Apr 12 00:58:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_requests' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:45 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 00:58:45 user nova-compute[82394]: INFO nova.compute.claims [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Claim successful on node user
Apr 12 00:58:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:46 user nova-compute[82394]: INFO nova.network.neutron [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating port 6c9e7810-9a63-4360-889c-edbd6af6ba4f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 4a67c354-55e9-4f42-bda3-35d16bf192db due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261126.7362423, 4a67c354-55e9-4f42-bda3-35d16bf192db => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:58:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Resumed (Lifecycle Event)
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:58:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261126.7405214, 4a67c354-55e9-4f42-bda3-35d16bf192db => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:58:46 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Started (Lifecycle Event)
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:46 user nova-compute[82394]: WARNING nova.compute.manager [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state active and task_state rescuing.
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:46 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.compute.manager [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing instance network info cache due to event network-changed-6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Acquiring lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.network.neutron [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 00:58:47 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Creating image(s)
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Acquired lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG nova.network.neutron [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Refreshing network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:47 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.part --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.part --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG nova.virt.images [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7 was qcow2, converting to raw {{(pid=82394) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG nova.privsep.utils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82394) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.part /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.converted {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.part /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.converted" returned: 0 in 0.323s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.converted --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updated VIF entry in instance network info cache for port 6c9e7810-9a63-4360-889c-edbd6af6ba4f. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 00:58:48 user nova-compute[82394]: DEBUG nova.network.neutron [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Releasing lock "refresh_cache-4e24bbae-7697-4c46-9c68-48d8393da608" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.520s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771,backing_fmt=raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771,backing_fmt=raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk 1073741824" returned: 0 in 0.048s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "e1f664faf87b8e72b5f5cc9a3e933bc51aacd771" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 --force-share --output=json" returned: 0 in 0.432s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:49 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'migration_context' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:49 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Rebasing disk image.
Apr 12 00:58:49 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 -F raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:50 user nova-compute[82394]: INFO nova.compute.manager [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Terminating instance
Apr 12 00:58:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 00:58:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Instance destroyed successfully.
Apr 12 00:58:51 user nova-compute[82394]: DEBUG nova.objects.instance [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lazy-loading 'resources' on Instance uuid 2c15d2ee-f758-414a-8167-aa95c17e60aa {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-148486663',display_name='tempest-VolumesActionsTest-instance-148486663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-148486663',id=43,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c3f0ad11ac49aaaec0a9c1827ddadb',ramdisk_id='',reservation_id='r-0f93xipm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1257118853',owner_user_name='tempest-VolumesActionsTest-1257118853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:57:06Z,user_data=None,user_id='845fc21f48594cb28ac9c770612a1830',uuid=2c15d2ee-f758-414a-8167-aa95c17e60aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converting VIF {"id": "eb075efa-9c5e-44db-b287-8172cee0658b", "address": "fa:16:3e:8c:4d:b7", "network": {"id": "49b3318f-9e48-43d8-97b1-1a2ec225e079", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532921305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38c3f0ad11ac49aaaec0a9c1827ddadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb075efa-9c", "ovs_interfaceid": "eb075efa-9c5e-44db-b287-8172cee0658b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG os_vif [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb075efa-9c, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:51 user nova-compute[82394]: INFO os_vif [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4d:b7,bridge_name='br-int',has_traffic_filtering=True,id=eb075efa-9c5e-44db-b287-8172cee0658b,network=Network(49b3318f-9e48-43d8-97b1-1a2ec225e079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb075efa-9c')
Apr 12 00:58:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Deleting instance files /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa_del
Apr 12 00:58:51 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Deletion of /opt/stack/data/nova/instances/2c15d2ee-f758-414a-8167-aa95c17e60aa_del complete
Apr 12 00:58:52 user nova-compute[82394]: INFO nova.compute.manager [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Took 1.36 seconds to destroy the instance on the hypervisor.
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 -F raw /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk" returned: 0 in 2.340s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Ensure instance console log exists: /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start _get_guest_xml network_info=[{"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b69f24e76a0b34426d329c2557003e94',container_format='bare',created_at=2023-04-12T00:56:53Z,direct_url=<?>,disk_format='qcow2',id=f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1629541624-shelved',owner='c26d891933d647b7b27c75915fb726f3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T00:56:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 00:58:52 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:52 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b69f24e76a0b34426d329c2557003e94',container_format='bare',created_at=2023-04-12T00:56:53Z,direct_url=<?>,disk_format='qcow2',id=f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1629541624-shelved',owner='c26d891933d647b7b27c75915fb726f3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T00:56:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-238651399',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:56:56.851220',shelved_host='user',shelved_image_id='f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] End _get_guest_xml xml=<domain type="kvm">
Apr 12 00:58:52 user nova-compute[82394]:   <uuid>4e24bbae-7697-4c46-9c68-48d8393da608</uuid>
Apr 12 00:58:52 user nova-compute[82394]:   <name>instance-0000002a</name>
Apr 12 00:58:52 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 00:58:52 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 00:58:52 user nova-compute[82394]:   <metadata>
Apr 12 00:58:52 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 00:58:52 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1629541624</nova:name>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:creationTime>2023-04-12 00:58:52</nova:creationTime>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 00:58:52 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 00:58:52 user nova-compute[82394]:       </nova:flavor>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:owner>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:user uuid="418881a7e56e4c19bbf900ef71029ce0">tempest-AttachVolumeShelveTestJSON-1335687803-project-member</nova:user>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:project uuid="c26d891933d647b7b27c75915fb726f3">tempest-AttachVolumeShelveTestJSON-1335687803</nova:project>
Apr 12 00:58:52 user nova-compute[82394]:       </nova:owner>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:root type="image" uuid="f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7"/>
Apr 12 00:58:52 user nova-compute[82394]:       <nova:ports>
Apr 12 00:58:52 user nova-compute[82394]:         <nova:port uuid="6c9e7810-9a63-4360-889c-edbd6af6ba4f">
Apr 12 00:58:52 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 00:58:52 user nova-compute[82394]:         </nova:port>
Apr 12 00:58:52 user nova-compute[82394]:       </nova:ports>
Apr 12 00:58:52 user nova-compute[82394]:     </nova:instance>
Apr 12 00:58:52 user nova-compute[82394]:   </metadata>
Apr 12 00:58:52 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 00:58:52 user nova-compute[82394]:     <system>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="serial">4e24bbae-7697-4c46-9c68-48d8393da608</entry>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="uuid">4e24bbae-7697-4c46-9c68-48d8393da608</entry>
Apr 12 00:58:52 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 00:58:52 user nova-compute[82394]:     </system>
Apr 12 00:58:52 user nova-compute[82394]:   </sysinfo>
Apr 12 00:58:52 user nova-compute[82394]:   <os>
Apr 12 00:58:52 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 00:58:52 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 00:58:52 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 00:58:52 user nova-compute[82394]:   </os>
Apr 12 00:58:52 user nova-compute[82394]:   <features>
Apr 12 00:58:52 user nova-compute[82394]:     <acpi/>
Apr 12 00:58:52 user nova-compute[82394]:     <apic/>
Apr 12 00:58:52 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 00:58:52 user nova-compute[82394]:   </features>
Apr 12 00:58:52 user nova-compute[82394]:   <clock offset="utc">
Apr 12 00:58:52 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 00:58:52 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 00:58:52 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 00:58:52 user nova-compute[82394]:   </clock>
Apr 12 00:58:52 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 00:58:52 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 00:58:52 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 00:58:52 user nova-compute[82394]:   </cpu>
Apr 12 00:58:52 user nova-compute[82394]:   <devices>
Apr 12 00:58:52 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 00:58:52 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 00:58:52 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk"/>
Apr 12 00:58:52 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 00:58:52 user nova-compute[82394]:     </disk>
Apr 12 00:58:52 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 00:58:52 user nova-compute[82394]:       <mac address="fa:16:3e:e2:1d:5b"/>
Apr 12 00:58:52 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:58:52 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 00:58:52 user nova-compute[82394]:       <target dev="tap6c9e7810-9a"/>
Apr 12 00:58:52 user nova-compute[82394]:     </interface>
Apr 12 00:58:52 user nova-compute[82394]:     <serial type="pty">
Apr 12 00:58:52 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/console.log" append="off"/>
Apr 12 00:58:52 user nova-compute[82394]:     </serial>
Apr 12 00:58:52 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 00:58:52 user nova-compute[82394]:     <video>
Apr 12 00:58:52 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 00:58:52 user nova-compute[82394]:     </video>
Apr 12 00:58:52 user nova-compute[82394]:     <rng model="virtio">
Apr 12 00:58:52 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 00:58:52 user nova-compute[82394]:     </rng>
Apr 12 00:58:52 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 00:58:52 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 00:58:52 user nova-compute[82394]:       <stats period="10"/>
Apr 12 00:58:52 user nova-compute[82394]:     </memballoon>
Apr 12 00:58:52 user nova-compute[82394]:   </devices>
Apr 12 00:58:52 user nova-compute[82394]: </domain>
Apr 12 00:58:52 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-238651399',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member',shelved_at='2023-04-12T00:56:56.851220',shelved_host='user',shelved_image_id='f79ed198-ccf5-4ff3-94be-54c1a6ce7ff7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T00:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG os_vif [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9e7810-9a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9e7810-9a, col_values=(('external_ids', {'iface-id': '6c9e7810-9a63-4360-889c-edbd6af6ba4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:1d:5b', 'vm-uuid': '4e24bbae-7697-4c46-9c68-48d8393da608'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:52 user nova-compute[82394]: INFO os_vif [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a')
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:52 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Took 0.51 seconds to deallocate network for instance.
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-deleted-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:52 user nova-compute[82394]: INFO nova.compute.manager [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Neutron deleted interface eb075efa-9c5e-44db-b287-8172cee0658b; detaching it from the instance and deleting it from the info cache
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.network.neutron [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.compute.manager [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Detach interface failed, port_id=eb075efa-9c5e-44db-b287-8172cee0658b, reason: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] No VIF found with MAC fa:16:3e:e2:1d:5b, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:52 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Deleted allocations for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa
Apr 12 00:58:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:53 user nova-compute[82394]: WARNING nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state deleted and task_state None.
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:53 user nova-compute[82394]: WARNING nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state deleted and task_state None.
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:53 user nova-compute[82394]: WARNING nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state deleted and task_state None.
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:53 user nova-compute[82394]: WARNING nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-unplugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state deleted and task_state None.
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "2c15d2ee-f758-414a-8167-aa95c17e60aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] No waiting events found dispatching network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:53 user nova-compute[82394]: WARNING nova.compute.manager [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Received unexpected event network-vif-plugged-eb075efa-9c5e-44db-b287-8172cee0658b for instance with vm_state deleted and task_state None.
Apr 12 00:58:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:54 user nova-compute[82394]: WARNING nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:58:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 00:58:54 user nova-compute[82394]: WARNING nova.compute.manager [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261135.9430308, 4e24bbae-7697-4c46-9c68-48d8393da608 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:58:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Resumed (Lifecycle Event)
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 00:58:55 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance spawned successfully.
Apr 12 00:58:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:58:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:58:55 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261135.948379, 4e24bbae-7697-4c46-9c68-48d8393da608 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:58:55 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Started (Lifecycle Event)
Apr 12 00:58:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 00:58:56 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 00:58:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:58:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.584s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:58:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:01 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:02 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 00:59:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:06 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261131.4561656, 2c15d2ee-f758-414a-8167-aa95c17e60aa => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 00:59:06 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] VM Stopped (Lifecycle Event)
Apr 12 00:59:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-051cf87e-ffba-4b88-8538-9ced7d658212 None None] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 00:59:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 00:59:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 00:59:12 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:59:12 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=26.163578033447266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4e24bbae-7697-4c46-9c68-48d8393da608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 00:59:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 00:59:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 00:59:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 00:59:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 00:59:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 00:59:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 00:59:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:00:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:00:11 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:00:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:00:13 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:00:13 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=26.16219711303711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4e24bbae-7697-4c46-9c68-48d8393da608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:00:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:00:15 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:00:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:00:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:00:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:00:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:00:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:00:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:29 user nova-compute[82394]: INFO nova.compute.manager [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Unrescuing
Apr 12 01:00:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:00:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:00:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'flavor' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:31 user nova-compute[82394]: DEBUG nova.compute.manager [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:31 user nova-compute[82394]: WARNING nova.compute.manager [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:00:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance destroyed successfully.
Apr 12 01:00:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing instance network info cache due to event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated VIF entry in instance network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing instance network info cache due to event network-changed-d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquired lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:00:33 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Refreshing network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updated VIF entry in instance network info cache for port d04a1887-8740-4c6c-a7b6-5e9e395ced98. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.network.neutron [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [{"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Releasing lock "refresh_cache-4a67c354-55e9-4f42-bda3-35d16bf192db" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:34 user nova-compute[82394]: WARNING nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:34 user nova-compute[82394]: WARNING nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:34 user nova-compute[82394]: WARNING nova.compute.manager [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.host [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Removed pending event for 4a67c354-55e9-4f42-bda3-35d16bf192db due to event {{(pid=82394) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261234.9100487, 4a67c354-55e9-4f42-bda3-35d16bf192db => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:00:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Resumed (Lifecycle Event)
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:00:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261234.9147742, 4a67c354-55e9-4f42-bda3-35d16bf192db => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:00:34 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Started (Lifecycle Event)
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:00:34 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:00:35 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 01:00:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:35 user nova-compute[82394]: INFO nova.compute.manager [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Terminating instance
Apr 12 01:00:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-unplugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:00:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Instance destroyed successfully.
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.objects.instance [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'resources' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T00:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1629541624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1629541624',id=42,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Wdo8lz+ZAHRli9jiADK4Sk7Y/NTuUS3pMEJzsy5L3/rQRehuzFZ0WTvUKDg92fAHcsMVP1vVTwrU696XzeqdiIx5fwn9f1xYz3ikBKgpnr3tCLjlykBzcNLc0GQnnbg==',key_name='tempest-keypair-238651399',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c26d891933d647b7b27c75915fb726f3',ramdisk_id='',reservation_id='r-rk8m59pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1335687803',owner_user_name='tempest-AttachVolumeShelveTestJSON-1335687803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T00:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='418881a7e56e4c19bbf900ef71029ce0',uuid=4e24bbae-7697-4c46-9c68-48d8393da608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converting VIF {"id": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "address": "fa:16:3e:e2:1d:5b", "network": {"id": "7ecd3c10-773d-4651-a82d-42b4aaad386f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1728181763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c26d891933d647b7b27c75915fb726f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e7810-9a", "ovs_interfaceid": "6c9e7810-9a63-4360-889c-edbd6af6ba4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG os_vif [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9e7810-9a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:00:36 user nova-compute[82394]: INFO os_vif [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:1d:5b,bridge_name='br-int',has_traffic_filtering=True,id=6c9e7810-9a63-4360-889c-edbd6af6ba4f,network=Network(7ecd3c10-773d-4651-a82d-42b4aaad386f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e7810-9a')
Apr 12 01:00:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Deleting instance files /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608_del
Apr 12 01:00:36 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Deletion of /opt/stack/data/nova/instances/4e24bbae-7697-4c46-9c68-48d8393da608_del complete
Apr 12 01:00:36 user nova-compute[82394]: INFO nova.compute.manager [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 01:00:36 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:00:36 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:00:37 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:00:37 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Took 0.69 seconds to deallocate network for instance.
Apr 12 01:00:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:37 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:00:37 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:00:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:37 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Deleted allocations for instance 4e24bbae-7697-4c46-9c68-48d8393da608
Apr 12 01:00:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "4e24bbae-7697-4c46-9c68-48d8393da608" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Acquiring lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:00:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:00:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Lock "4e24bbae-7697-4c46-9c68-48d8393da608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:00:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] No waiting events found dispatching network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:00:38 user nova-compute[82394]: WARNING nova.compute.manager [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received unexpected event network-vif-plugged-6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance with vm_state deleted and task_state None.
Apr 12 01:00:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Received event network-vif-deleted-6c9e7810-9a63-4360-889c-edbd6af6ba4f {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:00:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:51 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261236.6396503, 4e24bbae-7697-4c46-9c68-48d8393da608 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:00:51 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] VM Stopped (Lifecycle Event)
Apr 12 01:00:51 user nova-compute[82394]: DEBUG nova.compute.manager [None req-36e3fda8-6235-44ff-987d-7dd60d74f421 None None] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:00:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:00:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:03 user nova-compute[82394]: INFO nova.compute.manager [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Detaching volume e40b29b9-23d9-4c1e-88f1-f95983dbe508
Apr 12 01:01:03 user nova-compute[82394]: INFO nova.virt.block_device [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Attempting to driver detach volume e40b29b9-23d9-4c1e-88f1-f95983dbe508 from mountpoint /dev/vdb
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Attempting to detach device vdb from instance 4a67c354-55e9-4f42-bda3-35d16bf192db from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:01:03 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:01:03 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:01:03 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:01:03 user nova-compute[82394]:   <serial>e40b29b9-23d9-4c1e-88f1-f95983dbe508</serial>
Apr 12 01:01:03 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:01:03 user nova-compute[82394]: </disk>
Apr 12 01:01:03 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:01:03 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Successfully detached device vdb from instance 4a67c354-55e9-4f42-bda3-35d16bf192db from the persistent domain config.
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a67c354-55e9-4f42-bda3-35d16bf192db from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:01:03 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:01:03 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:01:03 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:01:03 user nova-compute[82394]:   <serial>e40b29b9-23d9-4c1e-88f1-f95983dbe508</serial>
Apr 12 01:01:03 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:01:03 user nova-compute[82394]: </disk>
Apr 12 01:01:03 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681261263.9254446, 4a67c354-55e9-4f42-bda3-35d16bf192db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:01:03 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Successfully detached device vdb from instance 4a67c354-55e9-4f42-bda3-35d16bf192db from the live domain config.
Apr 12 01:01:03 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNORPZAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:01:03 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c012460-d95b-4888-b9aa-e8d4ff7ea54e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:01:03 user nova-compute[82394]: No targets found.
Apr 12 01:01:03 user nova-compute[82394]: iSNS:
Apr 12 01:01:03 user nova-compute[82394]: No targets found.
Apr 12 01:01:03 user nova-compute[82394]: STATIC:
Apr 12 01:01:03 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508
Apr 12 01:01:03 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:01:03 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:01:03 user nova-compute[82394]: FIRMWARE:
Apr 12 01:01:03 user nova-compute[82394]: No targets found.
Apr 12 01:01:03 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:01:03 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:01:03 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a263a-5aed-4f5a-92f3-75ff22918145]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:03 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf33ebc-2b05-48de-83e8-582c40fb8f5b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 01:01:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 (non-flash)
Apr 12 01:01:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347c6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f9a2f-387f-4be6-8719-4c152fa7c536]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32ac2c-5fe8-4ad9-a604-46366c2b0f56]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a0ba3-57c8-4112-a756-84f13f951dbd]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7d8cc8-b957-407b-8b78-45d1227e48bf]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97443d88-fa25-44ab-b1b3-385f833d67c1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d442b20-ea71-418e-9398-bdcbaa1a4402]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260]
Apr 12 01:01:04 user nova-compute[82394]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508, portal: 172.16.0.220,3260] successful.
Apr 12 01:01:04 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40b29b9-23d9-4c1e-88f1-f95983dbe508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e1b53e-d2b2-4111-b910-e50b2476d8e2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] <== disconnect_volume: return (298ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:01:04 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'flavor' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:01:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:01:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:01:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:01:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:01:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:01:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=26.179988861083984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 4a67c354-55e9-4f42-bda3-35d16bf192db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:01:14 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:01:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:01:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:01:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:01:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:19 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:01:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:01:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:01:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:40 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:01:40 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:01:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:56 user nova-compute[82394]: INFO nova.compute.manager [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Terminating instance
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-unplugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Instance destroyed successfully.
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.objects.instance [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'resources' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T00:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-610910613',display_name='tempest-ServerStableDeviceRescueTest-server-610910613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-610910613',id=41,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkaYM4bzvKjlt+XK6hYKnU1Ed3vc/iv6lwsUyEh5UkHRise/0nAsGorrCmpbbpHQeoABf4SqJ+7Cj498V+6EsSu4dT7jtupY55U8ehZ3W+FlZGOucajkyX4bNIKLwnWQ==',key_name='tempest-keypair-1824777377',keypairs=<?>,launch_index=0,launched_at=2023-04-12T00:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21ca08eae6134a639c5f532e0742b3a2',ramdisk_id='',reservation_id='r-ixsey03c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2039136793',owner_user_name='tempest-ServerStableDeviceRescueTest-2039136793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aedb8da82a64bdcaeff07c649f05379',uuid=4a67c354-55e9-4f42-bda3-35d16bf192db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converting VIF {"id": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "address": "fa:16:3e:27:c9:9e", "network": {"id": "55f94ec9-8867-4883-ab9d-8a6dc2581156", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-530596640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca08eae6134a639c5f532e0742b3a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04a1887-87", "ovs_interfaceid": "d04a1887-8740-4c6c-a7b6-5e9e395ced98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG os_vif [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd04a1887-87, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:01:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:01:56 user nova-compute[82394]: INFO os_vif [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c9:9e,bridge_name='br-int',has_traffic_filtering=True,id=d04a1887-8740-4c6c-a7b6-5e9e395ced98,network=Network(55f94ec9-8867-4883-ab9d-8a6dc2581156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04a1887-87')
Apr 12 01:01:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Deleting instance files /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db_del
Apr 12 01:01:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Deletion of /opt/stack/data/nova/instances/4a67c354-55e9-4f42-bda3-35d16bf192db_del complete
Apr 12 01:01:57 user nova-compute[82394]: INFO nova.compute.manager [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 12 01:01:57 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:01:57 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:01:57 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:01:58 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Took 1.26 seconds to deallocate network for instance.
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-deleted-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:58 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Deleted allocations for instance 4a67c354-55e9-4f42-bda3-35d16bf192db
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Acquiring lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:01:58 user nova-compute[82394]: DEBUG nova.compute.manager [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] No waiting events found dispatching network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:01:58 user nova-compute[82394]: WARNING nova.compute.manager [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Received unexpected event network-vif-plugged-d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance with vm_state deleted and task_state None.
Apr 12 01:01:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "4a67c354-55e9-4f42-bda3-35d16bf192db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:04 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:02:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:11 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261316.9339707, 4a67c354-55e9-4f42-bda3-35d16bf192db => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:02:11 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] VM Stopped (Lifecycle Event)
Apr 12 01:02:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-cb96fe84-58bf-4cfe-b996-9253f9658fca None None] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:02:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:02:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:02:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:02:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=26.252777099609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:02:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:02:15 user nova-compute[82394]: INFO nova.compute.claims [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Claim successful on node user
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Skipping network cache update for instance because it is Building. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:02:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:02:15 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Creating image(s)
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "/opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "/opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "/opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG nova.policy [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:02:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk 1073741824" returned: 0 in 0.071s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Cannot resize image /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'migration_context' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Ensure instance console log exists: /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Successfully created port: dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:02:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Successfully updated port: dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquired lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-changed-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Refreshing instance network info cache due to event network-changed-dd8d7486-ceab-40ab-968e-58a3bfeafb25. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Acquiring lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updating instance_info_cache with network_info: [{"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Releasing lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Instance network_info: |[{"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Acquired lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Refreshing network info cache for port dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Start _get_guest_xml network_info=[{"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:02:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:02:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-99803033',display_name='tempest-VolumesSnapshotTestJSON-instance-99803033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-99803033',id=44,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-979fzecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:02:16Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=c797729d-b48e-4614-a47c-47ad714e78f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'pci_devices' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:02:17 user nova-compute[82394]:   <uuid>c797729d-b48e-4614-a47c-47ad714e78f1</uuid>
Apr 12 01:02:17 user nova-compute[82394]:   <name>instance-0000002c</name>
Apr 12 01:02:17 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:02:17 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:02:17 user nova-compute[82394]:   <metadata>
Apr 12 01:02:17 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:02:17 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-99803033</nova:name>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:02:17</nova:creationTime>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:02:17 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:02:17 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:owner>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:user uuid="37e45c15a3f348ec9862056beb628049">tempest-VolumesSnapshotTestJSON-490135070-project-member</nova:user>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:project uuid="8b090dd726e44a978a41caedb16a9737">tempest-VolumesSnapshotTestJSON-490135070</nova:project>
Apr 12 01:02:17 user nova-compute[82394]:       </nova:owner>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:02:17 user nova-compute[82394]:       <nova:ports>
Apr 12 01:02:17 user nova-compute[82394]:         <nova:port uuid="dd8d7486-ceab-40ab-968e-58a3bfeafb25">
Apr 12 01:02:17 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:02:17 user nova-compute[82394]:         </nova:port>
Apr 12 01:02:17 user nova-compute[82394]:       </nova:ports>
Apr 12 01:02:17 user nova-compute[82394]:     </nova:instance>
Apr 12 01:02:17 user nova-compute[82394]:   </metadata>
Apr 12 01:02:17 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:02:17 user nova-compute[82394]:     <system>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="serial">c797729d-b48e-4614-a47c-47ad714e78f1</entry>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="uuid">c797729d-b48e-4614-a47c-47ad714e78f1</entry>
Apr 12 01:02:17 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:02:17 user nova-compute[82394]:     </system>
Apr 12 01:02:17 user nova-compute[82394]:   </sysinfo>
Apr 12 01:02:17 user nova-compute[82394]:   <os>
Apr 12 01:02:17 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:02:17 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:02:17 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:02:17 user nova-compute[82394]:   </os>
Apr 12 01:02:17 user nova-compute[82394]:   <features>
Apr 12 01:02:17 user nova-compute[82394]:     <acpi/>
Apr 12 01:02:17 user nova-compute[82394]:     <apic/>
Apr 12 01:02:17 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:02:17 user nova-compute[82394]:   </features>
Apr 12 01:02:17 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:02:17 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:02:17 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:02:17 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:02:17 user nova-compute[82394]:   </clock>
Apr 12 01:02:17 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:02:17 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:02:17 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:02:17 user nova-compute[82394]:   </cpu>
Apr 12 01:02:17 user nova-compute[82394]:   <devices>
Apr 12 01:02:17 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:02:17 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:02:17 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk"/>
Apr 12 01:02:17 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:02:17 user nova-compute[82394]:     </disk>
Apr 12 01:02:17 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:02:17 user nova-compute[82394]:       <mac address="fa:16:3e:d4:8f:d1"/>
Apr 12 01:02:17 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:02:17 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:02:17 user nova-compute[82394]:       <target dev="tapdd8d7486-ce"/>
Apr 12 01:02:17 user nova-compute[82394]:     </interface>
Apr 12 01:02:17 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:02:17 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/console.log" append="off"/>
Apr 12 01:02:17 user nova-compute[82394]:     </serial>
Apr 12 01:02:17 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:02:17 user nova-compute[82394]:     <video>
Apr 12 01:02:17 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:02:17 user nova-compute[82394]:     </video>
Apr 12 01:02:17 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:02:17 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:02:17 user nova-compute[82394]:     </rng>
Apr 12 01:02:17 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:02:17 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:02:17 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:02:17 user nova-compute[82394]:     </memballoon>
Apr 12 01:02:17 user nova-compute[82394]:   </devices>
Apr 12 01:02:17 user nova-compute[82394]: </domain>
Apr 12 01:02:17 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-99803033',display_name='tempest-VolumesSnapshotTestJSON-instance-99803033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-99803033',id=44,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-979fzecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:02:16Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=c797729d-b48e-4614-a47c-47ad714e78f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG os_vif [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd8d7486-ce, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd8d7486-ce, col_values=(('external_ids', {'iface-id': 'dd8d7486-ceab-40ab-968e-58a3bfeafb25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:8f:d1', 'vm-uuid': 'c797729d-b48e-4614-a47c-47ad714e78f1'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:17 user nova-compute[82394]: INFO os_vif [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce')
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No VIF found with MAC fa:16:3e:d4:8f:d1, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:02:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updated VIF entry in instance network info cache for port dd8d7486-ceab-40ab-968e-58a3bfeafb25. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:02:18 user nova-compute[82394]: DEBUG nova.network.neutron [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updating instance_info_cache with network_info: [{"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:02:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Releasing lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] No waiting events found dispatching network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:02:19 user nova-compute[82394]: WARNING nova.compute.manager [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received unexpected event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance with vm_state building and task_state spawning.
Apr 12 01:02:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261341.208239, c797729d-b48e-4614-a47c-47ad714e78f1 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] VM Resumed (Lifecycle Event)
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Instance spawned successfully.
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261341.211625, c797729d-b48e-4614-a47c-47ad714e78f1 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] VM Started (Lifecycle Event)
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] No waiting events found dispatching network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:02:21 user nova-compute[82394]: WARNING nova.compute.manager [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received unexpected event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance with vm_state building and task_state spawning.
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 12 01:02:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:02:21 user nova-compute[82394]: INFO nova.compute.manager [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Took 6.12 seconds to build instance.
Apr 12 01:02:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.215s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:02:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:02:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:02:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:02:59 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:02:59 user nova-compute[82394]: INFO nova.compute.claims [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Claim successful on node user
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:03:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.policy [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:03:00 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Creating image(s)
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk 1073741824" returned: 0 in 0.052s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:00 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Successfully created port: bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Cannot resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'migration_context' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Ensure instance console log exists: /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Successfully updated port: bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-changed-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Refreshing instance network info cache due to event network-changed-bcdd6d2c-9283-4da8-b5b7-7f4311803431. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:03:01 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance network_info: |[{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Refreshing network info cache for port bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start _get_guest_xml network_info=[{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:03:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:03:02 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:03:02 user nova-compute[82394]:   <uuid>9d751ef5-bdbe-4b26-9499-5e17b63de0bb</uuid>
Apr 12 01:03:02 user nova-compute[82394]:   <name>instance-0000002d</name>
Apr 12 01:03:02 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:03:02 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:03:02 user nova-compute[82394]:   <metadata>
Apr 12 01:03:02 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:03:02 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeTestJSON-server-1063618078</nova:name>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:03:02</nova:creationTime>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:03:02 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:03:02 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:owner>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:user uuid="bc8bacd3b6194651bc5820c3221ed45e">tempest-AttachVolumeTestJSON-1807582141-project-member</nova:user>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:project uuid="8c9933281dea437cbaae1040fa06ff06">tempest-AttachVolumeTestJSON-1807582141</nova:project>
Apr 12 01:03:02 user nova-compute[82394]:       </nova:owner>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:03:02 user nova-compute[82394]:       <nova:ports>
Apr 12 01:03:02 user nova-compute[82394]:         <nova:port uuid="bcdd6d2c-9283-4da8-b5b7-7f4311803431">
Apr 12 01:03:02 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 01:03:02 user nova-compute[82394]:         </nova:port>
Apr 12 01:03:02 user nova-compute[82394]:       </nova:ports>
Apr 12 01:03:02 user nova-compute[82394]:     </nova:instance>
Apr 12 01:03:02 user nova-compute[82394]:   </metadata>
Apr 12 01:03:02 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:03:02 user nova-compute[82394]:     <system>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="serial">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="uuid">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:03:02 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:03:02 user nova-compute[82394]:     </system>
Apr 12 01:03:02 user nova-compute[82394]:   </sysinfo>
Apr 12 01:03:02 user nova-compute[82394]:   <os>
Apr 12 01:03:02 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:03:02 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:03:02 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:03:02 user nova-compute[82394]:   </os>
Apr 12 01:03:02 user nova-compute[82394]:   <features>
Apr 12 01:03:02 user nova-compute[82394]:     <acpi/>
Apr 12 01:03:02 user nova-compute[82394]:     <apic/>
Apr 12 01:03:02 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:03:02 user nova-compute[82394]:   </features>
Apr 12 01:03:02 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:03:02 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:03:02 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:03:02 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:03:02 user nova-compute[82394]:   </clock>
Apr 12 01:03:02 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:03:02 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:03:02 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:03:02 user nova-compute[82394]:   </cpu>
Apr 12 01:03:02 user nova-compute[82394]:   <devices>
Apr 12 01:03:02 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:03:02 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:03:02 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk"/>
Apr 12 01:03:02 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:03:02 user nova-compute[82394]:     </disk>
Apr 12 01:03:02 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:03:02 user nova-compute[82394]:       <mac address="fa:16:3e:64:31:1a"/>
Apr 12 01:03:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:03:02 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:03:02 user nova-compute[82394]:       <target dev="tapbcdd6d2c-92"/>
Apr 12 01:03:02 user nova-compute[82394]:     </interface>
Apr 12 01:03:02 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:03:02 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/console.log" append="off"/>
Apr 12 01:03:02 user nova-compute[82394]:     </serial>
Apr 12 01:03:02 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:03:02 user nova-compute[82394]:     <video>
Apr 12 01:03:02 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:03:02 user nova-compute[82394]:     </video>
Apr 12 01:03:02 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:03:02 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:03:02 user nova-compute[82394]:     </rng>
Apr 12 01:03:02 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:03:02 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:03:02 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:03:02 user nova-compute[82394]:     </memballoon>
Apr 12 01:03:02 user nova-compute[82394]:   </devices>
Apr 12 01:03:02 user nova-compute[82394]: </domain>
Apr 12 01:03:02 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG os_vif [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcdd6d2c-92, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcdd6d2c-92, col_values=(('external_ids', {'iface-id': 'bcdd6d2c-9283-4da8-b5b7-7f4311803431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:31:1a', 'vm-uuid': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:02 user nova-compute[82394]: INFO os_vif [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No VIF found with MAC fa:16:3e:64:31:1a, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated VIF entry in instance network info cache for port bcdd6d2c-9283-4da8-b5b7-7f4311803431. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG nova.network.neutron [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:03:02 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG nova.compute.manager [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:03 user nova-compute[82394]: DEBUG nova.compute.manager [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:03:03 user nova-compute[82394]: WARNING nova.compute.manager [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state building and task_state spawning.
Apr 12 01:03:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261385.6034155, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Resumed (Lifecycle Event)
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance spawned successfully.
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261385.6046298, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Started (Lifecycle Event)
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG nova.compute.manager [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:03:05 user nova-compute[82394]: WARNING nova.compute.manager [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state building and task_state spawning.
Apr 12 01:03:05 user nova-compute[82394]: INFO nova.compute.manager [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Took 5.86 seconds to build instance.
Apr 12 01:03:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.957s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:03:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:03:13 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:03:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:03:14 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:03:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=26.230751037597656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:03:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c797729d-b48e-4614-a47c-47ad714e78f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:03:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:03:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updating instance_info_cache with network_info: [{"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-c797729d-b48e-4614-a47c-47ad714e78f1" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:03:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:03:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:27 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:32 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:42 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:47 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:03:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:03:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG nova.objects.instance [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Ignoring supplied device name: /dev/vdb
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:05 user nova-compute[82394]: INFO nova.compute.manager [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Attaching volume ce9ed676-aba1-4c55-ad93-97cd0a68384d to /dev/vdb
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ab944-d554-40cf-bf4c-638724c1ef5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c59c92-4d3d-4d8b-a7f7-580861c88498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[768def60-ca28-427b-9357-2fe923db3953]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde7e9d-5602-4b30-b7ce-caff8ee08792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:04:05 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32bddf8-b467-4fc8-b486-0eaec5cf95a9]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG os_brick.utils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updating existing volume attachment record: 8e34fea2-c91c-4932-94a2-a976b7247274 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:04:05 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:04:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkMarbtf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:09 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:09 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:09 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b424e-998d-40bd-bef8-27b4b46c68ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:04:09 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ccc303-d13c-4f5d-9f9a-a89ff48a3786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d] added
Apr 12 01:04:09 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a7cb3-d075-4328-b46d-7c0176c76aed]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33342d-931b-4e21-a1b4-8b764c12d4c5]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkMarbtf {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkMarbtf" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0029a296-314c-4e84-9eac-4325807cc432]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkMarbtf'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1c3c3e-61ee-44d8-96a0-21951a7b1ae2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[30842a15-5483-4a54-9d04-2e89843c1d70]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:04:09 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:04:09 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:04:09 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:04:09 user nova-compute[82394]: 
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796245b-4bd6-4a07-bcb1-f13f8ba0738d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260]
Apr 12 01:04:09 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260] successful.
Apr 12 01:04:09 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40002c-6644-4920-a336-8af70491387d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:09 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b2a29-6760-4bc7-86e1-bf57143cc82a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)
Apr 12 01:04:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)
Apr 12 01:04:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ace6cf-3ddd-477f-8c64-628ddb1930fe]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkMarbtf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:04:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26231663830613234', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231663830613234', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.objects.instance [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:04:11 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:04:11 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:04:11 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:04:11 user nova-compute[82394]:   <serial>ce9ed676-aba1-4c55-ad93-97cd0a68384d</serial>
Apr 12 01:04:11 user nova-compute[82394]: </disk>
Apr 12 01:04:11 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No VIF found with MAC fa:16:3e:d4:8f:d1, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:04:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.147s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:04:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:04:14 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:15 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:04:15 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:04:15 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=26.20244598388672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance c797729d-b48e-4614-a47c-47ad714e78f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:04:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:04:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:04:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:04:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:19 user nova-compute[82394]: INFO nova.compute.manager [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Detaching volume ce9ed676-aba1-4c55-ad93-97cd0a68384d
Apr 12 01:04:19 user nova-compute[82394]: INFO nova.virt.block_device [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Attempting to driver detach volume ce9ed676-aba1-4c55-ad93-97cd0a68384d from mountpoint /dev/vdb
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Attempting to detach device vdb from instance c797729d-b48e-4614-a47c-47ad714e78f1 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:04:19 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:04:19 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:04:19 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:04:19 user nova-compute[82394]:   <serial>ce9ed676-aba1-4c55-ad93-97cd0a68384d</serial>
Apr 12 01:04:19 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:04:19 user nova-compute[82394]: </disk>
Apr 12 01:04:19 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:04:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully detached device vdb from instance c797729d-b48e-4614-a47c-47ad714e78f1 from the persistent domain config.
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c797729d-b48e-4614-a47c-47ad714e78f1 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:04:19 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:04:19 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:04:19 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:04:19 user nova-compute[82394]:   <serial>ce9ed676-aba1-4c55-ad93-97cd0a68384d</serial>
Apr 12 01:04:19 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:04:19 user nova-compute[82394]: </disk>
Apr 12 01:04:19 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681261459.6698434, c797729d-b48e-4614-a47c-47ad714e78f1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:04:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully detached device vdb from instance c797729d-b48e-4614-a47c-47ad714e78f1 from the live domain config.
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkMarbtf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b109cb-3640-4f6e-94c9-1cc0bcf80d41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:04:19 user nova-compute[82394]: No targets found.
Apr 12 01:04:19 user nova-compute[82394]: iSNS:
Apr 12 01:04:19 user nova-compute[82394]: No targets found.
Apr 12 01:04:19 user nova-compute[82394]: STATIC:
Apr 12 01:04:19 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d
Apr 12 01:04:19 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:04:19 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:04:19 user nova-compute[82394]: FIRMWARE:
Apr 12 01:04:19 user nova-compute[82394]: No targets found.
Apr 12 01:04:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:04:19 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:04:19 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c02fb-2ac3-43eb-899e-9fe728dbdfed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[01721312-212e-4a3b-a5ca-ebdec06fe342]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)
Apr 12 01:04:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d (non-flash)
Apr 12 01:04:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2347c5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b2eaf-5153-4c7d-a54a-97a0869513cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b14f5-52a2-46ff-b584-189c1589b251]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba91bf-f3e5-408f-894c-668967c5760c]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4dea9-35db-4f51-81d8-6af0f8506725]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97db21d-85b5-4e53-8420-ab957309f041]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddd497-f3ee-48e4-9c8a-9f6129215a54]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260]
Apr 12 01:04:19 user nova-compute[82394]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d, portal: 172.16.0.220,3260] successful.
Apr 12 01:04:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c10a0-2985-4d80-a30d-a2c7e53421a3]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== disconnect_volume: return (287ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.507s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:20 user nova-compute[82394]: INFO nova.compute.manager [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Terminating instance
Apr 12 01:04:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-unplugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] No waiting events found dispatching network-vif-unplugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-unplugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Instance destroyed successfully.
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'resources' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-99803033',display_name='tempest-VolumesSnapshotTestJSON-instance-99803033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-99803033',id=44,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-979fzecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:02:21Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=c797729d-b48e-4614-a47c-47ad714e78f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "address": "fa:16:3e:d4:8f:d1", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8d7486-ce", "ovs_interfaceid": "dd8d7486-ceab-40ab-968e-58a3bfeafb25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_vif [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd8d7486-ce, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:21 user nova-compute[82394]: INFO os_vif [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:8f:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd8d7486-ceab-40ab-968e-58a3bfeafb25,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8d7486-ce')
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:ce9ed676-aba1-4c55-ad93-97cd0a68384d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkMarbtf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:21 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2e688a37-e17a-4a7a-86ca-d5036d016bd6]: Unexpected error while running command.
Apr 12 01:04:21 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 01:04:21 user nova-compute[82394]: Exit code: 21
Apr 12 01:04:21 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 01:04:21 user nova-compute[82394]: Stderr: '' {{(pid=92359) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 12 01:04:21 user nova-compute[82394]: Traceback (most recent call last):
Apr 12 01:04:21 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 12 01:04:21 user nova-compute[82394]:     ret = func(*f_args, **f_kwargs)
Apr 12 01:04:21 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 12 01:04:21 user nova-compute[82394]:     return func(*args, **kwargs)
Apr 12 01:04:21 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 12 01:04:21 user nova-compute[82394]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 12 01:04:21 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 12 01:04:21 user nova-compute[82394]:     return putils.execute(on_execute=on_execute,
Apr 12 01:04:21 user nova-compute[82394]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 12 01:04:21 user nova-compute[82394]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 12 01:04:21 user nova-compute[82394]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 01:04:21 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 01:04:21 user nova-compute[82394]: Exit code: 21
Apr 12 01:04:21 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 01:04:21 user nova-compute[82394]: Stderr: ''
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e688a37-e17a-4a7a-86ca-d5036d016bd6]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 01:04:21 user nova-compute[82394]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 01:04:21 user nova-compute[82394]: Exit code: 21
Apr 12 01:04:21 user nova-compute[82394]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 01:04:21 user nova-compute[82394]: Stderr: ''
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 12 01:04:21 user nova-compute[82394]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=82394) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== disconnect_volume: return (25ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:04:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Deleting instance files /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1_del
Apr 12 01:04:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Deletion of /opt/stack/data/nova/instances/c797729d-b48e-4614-a47c-47ad714e78f1_del complete
Apr 12 01:04:21 user nova-compute[82394]: INFO nova.compute.manager [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 01:04:21 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:04:21 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:04:22 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:04:22 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Took 0.44 seconds to deallocate network for instance.
Apr 12 01:04:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-deleted-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:04:22 user nova-compute[82394]: WARNING nova.volume.cinder [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Attachment 8e34fea2-c91c-4932-94a2-a976b7247274 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8e34fea2-c91c-4932-94a2-a976b7247274. (HTTP 404) (Request-ID: req-e9d67343-8731-4ed7-ae41-65c6101587b2)
Apr 12 01:04:22 user nova-compute[82394]: INFO nova.compute.manager [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 01:04:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:22 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:04:22 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:04:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:22 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Deleted allocations for instance c797729d-b48e-4614-a47c-47ad714e78f1
Apr 12 01:04:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "c797729d-b48e-4614-a47c-47ad714e78f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.640s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:04:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Acquiring lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Lock "c797729d-b48e-4614-a47c-47ad714e78f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] No waiting events found dispatching network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:04:23 user nova-compute[82394]: WARNING nova.compute.manager [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Received unexpected event network-vif-plugged-dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance with vm_state deleted and task_state None.
Apr 12 01:04:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:04:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:36 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261461.534431, c797729d-b48e-4614-a47c-47ad714e78f1 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:04:36 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] VM Stopped (Lifecycle Event)
Apr 12 01:04:36 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e20d8fc7-f596-4f68-8a2b-1703c6e10584 None None] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:04:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:04:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-changed-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:04:50 user nova-compute[82394]: DEBUG nova.compute.manager [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Refreshing instance network info cache due to event network-changed-bcdd6d2c-9283-4da8-b5b7-7f4311803431. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:04:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:04:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:04:50 user nova-compute[82394]: DEBUG nova.network.neutron [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Refreshing network info cache for port bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:04:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated VIF entry in instance network info cache for port bcdd6d2c-9283-4da8-b5b7-7f4311803431. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:04:51 user nova-compute[82394]: DEBUG nova.network.neutron [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:04:51 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:04:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:52 user nova-compute[82394]: INFO nova.compute.manager [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Attaching volume 8c4c55f1-8a57-483a-a660-d4f65464d462 to /dev/vdb
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.utils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[18838348-2827-46c4-b3d7-e4a9c459fb99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[137947be-f906-4172-bc40-74e804e92c46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2e8ed8-d386-4ca7-b74f-605219ad1e89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[39acf690-9d93-4c07-b346-1394fd457502]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:04:52 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:04:52 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb0792-b4f8-4f66-a47d-b387cbf8a675]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG os_brick.utils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:52 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating existing volume attachment record: c7556de6-ca1d-4a38-94cc-870c76462050 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:04:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:04:56 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d54b69-8326-4b98-8dd8-3b9d9d2a5685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:04:56 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[02471da2-f176-4bb1-bada-2fad4ad49481]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462] added
Apr 12 01:04:56 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[36872d71-1f4a-453b-9463-bc525b7f3d8f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df107a9-f974-478e-8886-36cee7bae515]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lasyVkmM {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lasyVkmM" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7ba83-220b-4d5e-82d6-0254551a04d4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lasyVkmM'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[97106c08-9fc0-4fc9-ab9d-17ecadcef3f4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac1eb35-9126-472d-adf4-080c62ffc371]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:04:56 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:56 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:04:56 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:04:56 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:04:56 user nova-compute[82394]: 
Apr 12 01:04:56 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c43e2-d67a-4e30-83c2-73c5c93526cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]
Apr 12 01:04:57 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.
Apr 12 01:04:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf915da-b8fe-4e3d-854a-1b5f390c9ce8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34ceee-4eb4-448b-a552-8442e53030e4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:04:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:04:57 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0a0751-93fb-4028-835a-1ee220778d79]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:04:57 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '26535663531613761', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535663531613761', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.objects.instance [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:04:58 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:04:58 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:04:58 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:04:58 user nova-compute[82394]:   <serial>8c4c55f1-8a57-483a-a660-d4f65464d462</serial>
Apr 12 01:04:58 user nova-compute[82394]: </disk>
Apr 12 01:04:58 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No VIF found with MAC fa:16:3e:64:31:1a, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:04:58 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.056s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82394) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.objects.instance [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.compute.manager [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:04:59 user nova-compute[82394]: WARNING nova.compute.manager [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state active and task_state powering-off.
Apr 12 01:04:59 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance destroyed successfully.
Apr 12 01:04:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:05:00 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.835s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:01 user nova-compute[82394]: DEBUG nova.compute.manager [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:05:01 user nova-compute[82394]: WARNING nova.compute.manager [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state stopped and task_state None.
Apr 12 01:05:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:07 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:05:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:14 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261499.973138, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:05:14 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Stopped (Lifecycle Event)
Apr 12 01:05:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62b80895-cbf8-44f9-9abd-318effffc524 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:05:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-62b80895-cbf8-44f9-9abd-318effffc524 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:05:15 user nova-compute[82394]: INFO nova.compute.claims [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Claim successful on node user
Apr 12 01:05:15 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:05:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.policy [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:05:16 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Creating image(s)
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "/opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "/opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk 1073741824" returned: 0 in 0.047s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Successfully created port: 5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'migration_context' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:05:16 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Successfully updated port: 5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-changed-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.manager [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Refreshing instance network info cache due to event network-changed-5712cd10-28ae-41a2-bb88-dc250f896d37. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Acquiring lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Acquired lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Refreshing network info cache for port 5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:05:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:05:17 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=26.218791961669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d5a16f3f-6322-4212-8f32-dec6eb161780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Releasing lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquired lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:05:17 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Updating instance_info_cache with network_info: [{"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Releasing lock "refresh_cache-d5a16f3f-6322-4212-8f32-dec6eb161780" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance network_info: |[{"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Start _get_guest_xml network_info=[{"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:05:18 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:05:18 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-685862765',display_name='tempest-VolumesSnapshotTestJSON-instance-685862765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-685862765',id=46,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-svi474v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:05:16Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=d5a16f3f-6322-4212-8f32-dec6eb161780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.objects.instance [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:05:18 user nova-compute[82394]:   <uuid>d5a16f3f-6322-4212-8f32-dec6eb161780</uuid>
Apr 12 01:05:18 user nova-compute[82394]:   <name>instance-0000002e</name>
Apr 12 01:05:18 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:05:18 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:05:18 user nova-compute[82394]:   <metadata>
Apr 12 01:05:18 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:05:18 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-685862765</nova:name>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:05:18</nova:creationTime>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:05:18 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:05:18 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:owner>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:user uuid="37e45c15a3f348ec9862056beb628049">tempest-VolumesSnapshotTestJSON-490135070-project-member</nova:user>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:project uuid="8b090dd726e44a978a41caedb16a9737">tempest-VolumesSnapshotTestJSON-490135070</nova:project>
Apr 12 01:05:18 user nova-compute[82394]:       </nova:owner>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:05:18 user nova-compute[82394]:       <nova:ports>
Apr 12 01:05:18 user nova-compute[82394]:         <nova:port uuid="5712cd10-28ae-41a2-bb88-dc250f896d37">
Apr 12 01:05:18 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 01:05:18 user nova-compute[82394]:         </nova:port>
Apr 12 01:05:18 user nova-compute[82394]:       </nova:ports>
Apr 12 01:05:18 user nova-compute[82394]:     </nova:instance>
Apr 12 01:05:18 user nova-compute[82394]:   </metadata>
Apr 12 01:05:18 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:05:18 user nova-compute[82394]:     <system>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="serial">d5a16f3f-6322-4212-8f32-dec6eb161780</entry>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="uuid">d5a16f3f-6322-4212-8f32-dec6eb161780</entry>
Apr 12 01:05:18 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:05:18 user nova-compute[82394]:     </system>
Apr 12 01:05:18 user nova-compute[82394]:   </sysinfo>
Apr 12 01:05:18 user nova-compute[82394]:   <os>
Apr 12 01:05:18 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:05:18 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:05:18 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:05:18 user nova-compute[82394]:   </os>
Apr 12 01:05:18 user nova-compute[82394]:   <features>
Apr 12 01:05:18 user nova-compute[82394]:     <acpi/>
Apr 12 01:05:18 user nova-compute[82394]:     <apic/>
Apr 12 01:05:18 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:05:18 user nova-compute[82394]:   </features>
Apr 12 01:05:18 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:05:18 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:05:18 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:05:18 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:05:18 user nova-compute[82394]:   </clock>
Apr 12 01:05:18 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:05:18 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:05:18 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:05:18 user nova-compute[82394]:   </cpu>
Apr 12 01:05:18 user nova-compute[82394]:   <devices>
Apr 12 01:05:18 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:05:18 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:05:18 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk"/>
Apr 12 01:05:18 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:05:18 user nova-compute[82394]:     </disk>
Apr 12 01:05:18 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:05:18 user nova-compute[82394]:       <mac address="fa:16:3e:e0:1e:a3"/>
Apr 12 01:05:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:05:18 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:05:18 user nova-compute[82394]:       <target dev="tap5712cd10-28"/>
Apr 12 01:05:18 user nova-compute[82394]:     </interface>
Apr 12 01:05:18 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:05:18 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/console.log" append="off"/>
Apr 12 01:05:18 user nova-compute[82394]:     </serial>
Apr 12 01:05:18 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:05:18 user nova-compute[82394]:     <video>
Apr 12 01:05:18 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:05:18 user nova-compute[82394]:     </video>
Apr 12 01:05:18 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:05:18 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:05:18 user nova-compute[82394]:     </rng>
Apr 12 01:05:18 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:05:18 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:05:18 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:05:18 user nova-compute[82394]:     </memballoon>
Apr 12 01:05:18 user nova-compute[82394]:   </devices>
Apr 12 01:05:18 user nova-compute[82394]: </domain>
Apr 12 01:05:18 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-685862765',display_name='tempest-VolumesSnapshotTestJSON-instance-685862765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-685862765',id=46,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-svi474v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:05:16Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=d5a16f3f-6322-4212-8f32-dec6eb161780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG os_vif [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5712cd10-28, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5712cd10-28, col_values=(('external_ids', {'iface-id': '5712cd10-28ae-41a2-bb88-dc250f896d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:1e:a3', 'vm-uuid': 'd5a16f3f-6322-4212-8f32-dec6eb161780'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:18 user nova-compute[82394]: INFO os_vif [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28')
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:05:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No VIF found with MAC fa:16:3e:e0:1e:a3, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:19 user nova-compute[82394]: DEBUG nova.compute.manager [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] No waiting events found dispatching network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:05:19 user nova-compute[82394]: WARNING nova.compute.manager [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received unexpected event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 for instance with vm_state building and task_state spawning.
Apr 12 01:05:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Skipping network cache update for instance because it is Building. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:05:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261521.7815094, d5a16f3f-6322-4212-8f32-dec6eb161780 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] VM Resumed (Lifecycle Event)
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance spawned successfully.
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261521.7829812, d5a16f3f-6322-4212-8f32-dec6eb161780 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] VM Started (Lifecycle Event)
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] No waiting events found dispatching network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:05:21 user nova-compute[82394]: WARNING nova.compute.manager [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received unexpected event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 for instance with vm_state building and task_state spawning.
Apr 12 01:05:21 user nova-compute[82394]: INFO nova.compute.manager [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Took 6.25 seconds to build instance.
Apr 12 01:05:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.351s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Verify base images {{(pid=82394) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Image id 7ae54858-7fe8-4bde-be8c-1b0f88b691ea yields fingerprint af28a99db336a2589fefead5323483e479274997 {{(pid=82394) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 01:05:37 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] image 7ae54858-7fe8-4bde-be8c-1b0f88b691ea at (/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997): checking
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] image 7ae54858-7fe8-4bde-be8c-1b0f88b691ea at (/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997): image is in use {{(pid=82394) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82394) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] 9d751ef5-bdbe-4b26-9499-5e17b63de0bb is a valid instance name {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] 9d751ef5-bdbe-4b26-9499-5e17b63de0bb has a disk file {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:37 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb is backed by af28a99db336a2589fefead5323483e479274997 {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] d5a16f3f-6322-4212-8f32-dec6eb161780 is a valid instance name {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] d5a16f3f-6322-4212-8f32-dec6eb161780 has a disk file {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d5a16f3f-6322-4212-8f32-dec6eb161780 is backed by af28a99db336a2589fefead5323483e479274997 {{(pid=82394) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5
Apr 12 01:05:38 user nova-compute[82394]: WARNING nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Unknown base file: /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Active base files: /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Removable base files: /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771 /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254 /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19 /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2 /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817 /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5 /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d5559ececf8a3f4b186a1aee5f17015ccb2449c
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1f664faf87b8e72b5f5cc9a3e933bc51aacd771
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5bfcbfc9d11bf6091238867a0f439ddd1b12254
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee4f62c1afd903097aa029248ce017aebb763b19
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d45be03e1049ac760afe31ef3aa68b688f378bda
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4aa2b1159115a45557aa420a9573fa5d14424bc2
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04ece137a5e8b03dbf48afd8104cb6b9c713b817
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a0587ed801ac90ccc13c2924fd34da653566d7c5
Apr 12 01:05:38 user nova-compute[82394]: INFO nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/15d09d2d162d7c61c2051e367ea199a179ef464a
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Verification complete {{(pid=82394) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Verify swap images {{(pid=82394) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG nova.virt.libvirt.imagecache [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Verify ephemeral images {{(pid=82394) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 01:05:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:53 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:05:58 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:03 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:07 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:08 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:08 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:06:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:12 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:13 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:06:18 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:06:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:06:19 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:06:19 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=26.199161529541016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:06:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d5a16f3f-6322-4212-8f32-dec6eb161780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:06:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:06:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:06:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:06:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:06:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:27 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:28 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:06:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:06:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:38 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:06:48 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:49 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:06:49 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:06:49 user nova-compute[82394]: DEBUG nova.network.neutron [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:06:49 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.network.neutron [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:06:50 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance destroyed successfully.
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'resources' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcdd6d2c-92, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:50 user nova-compute[82394]: INFO os_vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:06:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e9ca9-223b-47aa-bf2a-293ec6653bee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:06:50 user nova-compute[82394]: No targets found.
Apr 12 01:06:50 user nova-compute[82394]: iSNS:
Apr 12 01:06:50 user nova-compute[82394]: No targets found.
Apr 12 01:06:50 user nova-compute[82394]: STATIC:
Apr 12 01:06:50 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462
Apr 12 01:06:50 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:06:50 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:06:50 user nova-compute[82394]: FIRMWARE:
Apr 12 01:06:50 user nova-compute[82394]: No targets found.
Apr 12 01:06:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:06:50 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:06:50 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc78e08b-0cb8-46bf-b2a9-1be61d935aa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a942d8e-b7f5-4374-b530-04238bceb48c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:06:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:06:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0edcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5120580c-32a2-4155-b97b-a5097ab04a61]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d9d1c-a020-47f2-82af-143d96d7dd67]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa99765-4089-44a8-9230-5190601c967b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[61032450-eaa7-463e-8fa6-f93d222b542a]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd39d5-1b4e-4b52-96ec-7c9668dc37aa]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4c04d-5bd6-4dc4-b524-47226c0d6316]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]
Apr 12 01:06:50 user nova-compute[82394]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.
Apr 12 01:06:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f4a40-7773-4b49-bfac-a0b1495ad23f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== disconnect_volume: return (300ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start _get_guest_xml network_info=[{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c7556de6-ca1d-4a38-94cc-870c76462050', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb', 'attached_at': '', 'detached_at': '', 'volume_id': '8c4c55f1-8a57-483a-a660-d4f65464d462', 'serial': '8c4c55f1-8a57-483a-a660-d4f65464d462'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:06:50 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:06:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:06:50 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:06:50 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab6bc1-a4f0-4cd0-aebc-e39880d3e75b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:06:50 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa04c9e-5d6c-48e1-ab78-21ea2c15b52a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462] added
Apr 12 01:06:50 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[541122a5-df0d-4398-8176-a4e3e367829f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[739120ca-a1d1-49a6-80d2-a6bd9600e6f8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lasyVkmM {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lasyVkmM" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:50 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617536e-7717-429e-830f-4832ab56cc2d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lasyVkmM'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[84912dcb-833d-4ace-a4bc-14d1bbe88c51]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021e75e-cf6b-44ae-8296-f585f8a3df8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:06:51 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:06:51 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:06:51 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:06:51 user nova-compute[82394]: 
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d085af-5532-4d43-b94e-42e1c8ee3a3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]
Apr 12 01:06:51 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.
Apr 12 01:06:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa00f881-5499-4b95-9404-160d0034dea6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd9cc8-9541-436d-ac5e-91b00117d543]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:06:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:06:51 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7353128-13b8-457c-a136-f680fee42802]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:06:51 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26535663531613761', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535663531613761', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:06:52 user nova-compute[82394]:   <uuid>9d751ef5-bdbe-4b26-9499-5e17b63de0bb</uuid>
Apr 12 01:06:52 user nova-compute[82394]:   <name>instance-0000002d</name>
Apr 12 01:06:52 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:06:52 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:06:52 user nova-compute[82394]:   <metadata>
Apr 12 01:06:52 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:06:52 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeTestJSON-server-1063618078</nova:name>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:06:50</nova:creationTime>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:06:52 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:06:52 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:owner>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:user uuid="bc8bacd3b6194651bc5820c3221ed45e">tempest-AttachVolumeTestJSON-1807582141-project-member</nova:user>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:project uuid="8c9933281dea437cbaae1040fa06ff06">tempest-AttachVolumeTestJSON-1807582141</nova:project>
Apr 12 01:06:52 user nova-compute[82394]:       </nova:owner>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:06:52 user nova-compute[82394]:       <nova:ports>
Apr 12 01:06:52 user nova-compute[82394]:         <nova:port uuid="bcdd6d2c-9283-4da8-b5b7-7f4311803431">
Apr 12 01:06:52 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 01:06:52 user nova-compute[82394]:         </nova:port>
Apr 12 01:06:52 user nova-compute[82394]:       </nova:ports>
Apr 12 01:06:52 user nova-compute[82394]:     </nova:instance>
Apr 12 01:06:52 user nova-compute[82394]:   </metadata>
Apr 12 01:06:52 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:06:52 user nova-compute[82394]:     <system>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="serial">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="uuid">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:06:52 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:06:52 user nova-compute[82394]:     </system>
Apr 12 01:06:52 user nova-compute[82394]:   </sysinfo>
Apr 12 01:06:52 user nova-compute[82394]:   <os>
Apr 12 01:06:52 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:06:52 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:06:52 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:06:52 user nova-compute[82394]:   </os>
Apr 12 01:06:52 user nova-compute[82394]:   <features>
Apr 12 01:06:52 user nova-compute[82394]:     <acpi/>
Apr 12 01:06:52 user nova-compute[82394]:     <apic/>
Apr 12 01:06:52 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:06:52 user nova-compute[82394]:   </features>
Apr 12 01:06:52 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:06:52 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:06:52 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:06:52 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:06:52 user nova-compute[82394]:   </clock>
Apr 12 01:06:52 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:06:52 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:06:52 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:06:52 user nova-compute[82394]:   </cpu>
Apr 12 01:06:52 user nova-compute[82394]:   <devices>
Apr 12 01:06:52 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:06:52 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:06:52 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk"/>
Apr 12 01:06:52 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:06:52 user nova-compute[82394]:     </disk>
Apr 12 01:06:52 user nova-compute[82394]:     <disk type="block" device="disk">
Apr 12 01:06:52 user nova-compute[82394]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:06:52 user nova-compute[82394]:       <source dev="/dev/sdb"/>
Apr 12 01:06:52 user nova-compute[82394]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:06:52 user nova-compute[82394]:       <serial>8c4c55f1-8a57-483a-a660-d4f65464d462</serial>
Apr 12 01:06:52 user nova-compute[82394]:     </disk>
Apr 12 01:06:52 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:06:52 user nova-compute[82394]:       <mac address="fa:16:3e:64:31:1a"/>
Apr 12 01:06:52 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:06:52 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:06:52 user nova-compute[82394]:       <target dev="tapbcdd6d2c-92"/>
Apr 12 01:06:52 user nova-compute[82394]:     </interface>
Apr 12 01:06:52 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:06:52 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/console.log" append="off"/>
Apr 12 01:06:52 user nova-compute[82394]:     </serial>
Apr 12 01:06:52 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:06:52 user nova-compute[82394]:     <video>
Apr 12 01:06:52 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:06:52 user nova-compute[82394]:     </video>
Apr 12 01:06:52 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:06:52 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:06:52 user nova-compute[82394]:     </rng>
Apr 12 01:06:52 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:06:52 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:06:52 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:06:52 user nova-compute[82394]:     </memballoon>
Apr 12 01:06:52 user nova-compute[82394]:   </devices>
Apr 12 01:06:52 user nova-compute[82394]: </domain>
Apr 12 01:06:52 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.145s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Cannot resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.objects.instance [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'migration_context' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG os_vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcdd6d2c-92, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcdd6d2c-92, col_values=(('external_ids', {'iface-id': 'bcdd6d2c-9283-4da8-b5b7-7f4311803431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:31:1a', 'vm-uuid': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:06:52 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:52 user nova-compute[82394]: INFO os_vif [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG nova.compute.manager [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:06:54 user nova-compute[82394]: WARNING nova.compute.manager [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261616.3543406, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:06:56 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Resumed (Lifecycle Event)
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:06:56 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance rebooted successfully.
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:06:56 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261616.3557785, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:06:56 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Started (Lifecycle Event)
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:06:56 user nova-compute[82394]: DEBUG nova.compute.manager [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:06:56 user nova-compute[82394]: WARNING nova.compute.manager [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state active and task_state None.
Apr 12 01:06:57 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:02 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:05 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:07:05 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Ignoring supplied device name: /dev/vdb
Apr 12 01:07:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:05 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:05 user nova-compute[82394]: INFO nova.compute.manager [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Attaching volume e18973ee-543f-44f4-8032-3153cf1b7d43 to /dev/vdb
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f272a-0131-4d19-8384-92f9e92d5fdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9890beb-0761-4d28-94ab-ce7a5be2f027]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[42157a5a-d388-456f-90c1-1d13bd31a339]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411df2d-fb32-4be1-a745-1779cb56f6c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:07:06 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:07:06 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea4ee5-5214-4d81-ace6-d12392f6ca77]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG os_brick.utils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:07:06 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Updating existing volume attachment record: 15ed0f9d-9d10-4aeb-a41d-6ed91b478ae4 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:07:07 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:07:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:09 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:09 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqZLgJpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:07:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:07:10 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:07:10 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a448255-a3e6-482a-a163-27df44a44f26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:07:10 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7347f171-542b-441d-91bb-d9316dad505f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43] added
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e8828-a53a-4053-9cd5-ee7ae1ffe3a2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225a41f-52ba-45dc-bec5-19422785ced7]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqZLgJpz {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqZLgJpz" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb39b0c0-a3f0-4e69-9d84-517ee4174c7a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cqZLgJpz'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b859930-5ddb-407e-8d6b-89ccd3af30c1]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3e973-b3b9-4d94-9b28-d05b0869d5af]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf085e-a42d-41d3-b76c-1673b4a48020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260]
Apr 12 01:07:10 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260] successful.
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb40ec1-5119-4c98-9f38-97908e1e448a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c8c6d4-5b1b-444d-8c02-9900058a87b1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)
Apr 12 01:07:10 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a0f28-3ec4-4a12-9334-68b24a06290d]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:10 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqZLgJpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26533633862393236', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633862393236', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:07:11 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:07:11 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:07:11 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:07:11 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:07:11 user nova-compute[82394]:   <serial>e18973ee-543f-44f4-8032-3153cf1b7d43</serial>
Apr 12 01:07:11 user nova-compute[82394]: </disk>
Apr 12 01:07:11 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:07:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:07:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:07:12 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] No VIF found with MAC fa:16:3e:e0:1e:a3, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:07:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.483s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:12 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:17 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:18 user nova-compute[82394]: INFO nova.compute.manager [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Detaching volume e18973ee-543f-44f4-8032-3153cf1b7d43
Apr 12 01:07:18 user nova-compute[82394]: INFO nova.virt.block_device [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Attempting to driver detach volume e18973ee-543f-44f4-8032-3153cf1b7d43 from mountpoint /dev/vdb
Apr 12 01:07:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Attempting to detach device vdb from instance d5a16f3f-6322-4212-8f32-dec6eb161780 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:07:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:07:18 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:07:18 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:07:18 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:07:18 user nova-compute[82394]:   <serial>e18973ee-543f-44f4-8032-3153cf1b7d43</serial>
Apr 12 01:07:18 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:07:18 user nova-compute[82394]: </disk>
Apr 12 01:07:18 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:07:18 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully detached device vdb from instance d5a16f3f-6322-4212-8f32-dec6eb161780 from the persistent domain config.
Apr 12 01:07:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5a16f3f-6322-4212-8f32-dec6eb161780 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:07:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:07:18 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:07:18 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:07:18 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:07:18 user nova-compute[82394]:   <serial>e18973ee-543f-44f4-8032-3153cf1b7d43</serial>
Apr 12 01:07:18 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:07:18 user nova-compute[82394]: </disk>
Apr 12 01:07:18 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:07:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681261639.1793635, d5a16f3f-6322-4212-8f32-dec6eb161780 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:07:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully detached device vdb from instance d5a16f3f-6322-4212-8f32-dec6eb161780 from the live domain config.
Apr 12 01:07:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqZLgJpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:07:19 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c531ad27-e621-4b50-9b0f-c51e2cff0ca1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:07:19 user nova-compute[82394]: No targets found.
Apr 12 01:07:19 user nova-compute[82394]: iSNS:
Apr 12 01:07:19 user nova-compute[82394]: No targets found.
Apr 12 01:07:19 user nova-compute[82394]: STATIC:
Apr 12 01:07:19 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43
Apr 12 01:07:19 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:07:19 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:07:19 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462
Apr 12 01:07:19 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:07:19 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:07:19 user nova-compute[82394]: FIRMWARE:
Apr 12 01:07:19 user nova-compute[82394]: No targets found.
Apr 12 01:07:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:07:19 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:07:19 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e327d52-0e65-44ca-b0ec-2789ad989fe2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80cd211-23a1-404d-ae32-898a2cffb95f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:19 user nova-compute[82394]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)
Apr 12 01:07:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:19 user nova-compute[82394]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 (non-flash)
Apr 12 01:07:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0e35360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43'): ({'sdc'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Removing single pathed devices sdc {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614f6fa-8f48-46c3-9fc0-12dda48e8187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[77412c07-996d-4db1-9ede-5e90ea0c28e5]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flushing IO for device /dev/sdc {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56bc491-5e3b-4b51-9a85-f344b1a6ebf6]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ee7c6-b746-4197-9777-ece805fb29f2]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea9bcfe-55c5-453b-895d-23a985b43384]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac0345-2809-4f5e-a417-d852f63d5b1a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260]
Apr 12 01:07:19 user nova-compute[82394]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43, portal: 172.16.0.220,3260] successful.
Apr 12 01:07:19 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[14066cf3-36e6-46cb-8571-7563162444c4]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== disconnect_volume: return (315ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:07:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'flavor' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.552s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:20 user nova-compute[82394]: INFO nova.compute.manager [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Terminating instance
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-unplugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] No waiting events found dispatching network-vif-unplugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-unplugged-5712cd10-28ae-41a2-bb88-dc250f896d37 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Skipping network cache update for instance because it is being deleted. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:07:20 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Instance destroyed successfully.
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'resources' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-685862765',display_name='tempest-VolumesSnapshotTestJSON-instance-685862765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-685862765',id=46,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:05:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b090dd726e44a978a41caedb16a9737',ramdisk_id='',reservation_id='r-svi474v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-490135070',owner_user_name='tempest-VolumesSnapshotTestJSON-490135070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:05:22Z,user_data=None,user_id='37e45c15a3f348ec9862056beb628049',uuid=d5a16f3f-6322-4212-8f32-dec6eb161780,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converting VIF {"id": "5712cd10-28ae-41a2-bb88-dc250f896d37", "address": "fa:16:3e:e0:1e:a3", "network": {"id": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1306001217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8b090dd726e44a978a41caedb16a9737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5712cd10-28", "ovs_interfaceid": "5712cd10-28ae-41a2-bb88-dc250f896d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_vif [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5712cd10-28, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:07:20 user nova-compute[82394]: INFO os_vif [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:1e:a3,bridge_name='br-int',has_traffic_filtering=True,id=5712cd10-28ae-41a2-bb88-dc250f896d37,network=Network(d7d7d428-1112-4a7b-bddd-0b8ff59971d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5712cd10-28')
Apr 12 01:07:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqZLgJpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:07:20 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b039b6-f110-481e-85cd-9e0d7e10623b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:07:20 user nova-compute[82394]: No targets found.
Apr 12 01:07:20 user nova-compute[82394]: iSNS:
Apr 12 01:07:20 user nova-compute[82394]: No targets found.
Apr 12 01:07:20 user nova-compute[82394]: STATIC:
Apr 12 01:07:20 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462
Apr 12 01:07:20 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:07:20 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:07:20 user nova-compute[82394]: FIRMWARE:
Apr 12 01:07:20 user nova-compute[82394]: No targets found.
Apr 12 01:07:20 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:07:20 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:07:20 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18973ee-543f-44f4-8032-3153cf1b7d43', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53f6717-4f26-4405-8953-12ac0def0518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495dfa5-d17c-4fee-8767-1870fac89889]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:07:21 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1f0ebb7f0>, {}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Disconnecting from: [] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] <== disconnect_volume: return (109ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Deleting instance files /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780_del
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Deletion of /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780_del complete
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json" returned: 1 in 0.130s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk --force-share --output=json' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:07:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/d5a16f3f-6322-4212-8f32-dec6eb161780/disk
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.compute.manager [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Took 0.79 seconds to destroy the instance on the hypervisor.
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-deleted-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.compute.manager [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Neutron deleted interface 5712cd10-28ae-41a2-bb88-dc250f896d37; detaching it from the instance and deleting it from the info cache
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:07:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:07:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=26.197124481201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Took 0.78 seconds to deallocate network for instance.
Apr 12 01:07:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Detach interface failed, port_id=5712cd10-28ae-41a2-bb88-dc250f896d37, reason: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. {{(pid=82394) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:07:21 user nova-compute[82394]: WARNING nova.volume.cinder [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Attachment 15ed0f9d-9d10-4aeb-a41d-6ed91b478ae4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 15ed0f9d-9d10-4aeb-a41d-6ed91b478ae4. (HTTP 404) (Request-ID: req-3481d047-1800-46fd-a143-0553ba3f7300)
Apr 12 01:07:21 user nova-compute[82394]: INFO nova.compute.manager [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance d5a16f3f-6322-4212-8f32-dec6eb161780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.140s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:22 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Deleted allocations for instance d5a16f3f-6322-4212-8f32-dec6eb161780
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Acquiring lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Lock "d5a16f3f-6322-4212-8f32-dec6eb161780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:22 user nova-compute[82394]: DEBUG nova.compute.manager [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] No waiting events found dispatching network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:07:22 user nova-compute[82394]: WARNING nova.compute.manager [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Received unexpected event network-vif-plugged-5712cd10-28ae-41a2-bb88-dc250f896d37 for instance with vm_state deleted and task_state None.
Apr 12 01:07:23 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261640.8961596, d5a16f3f-6322-4212-8f32-dec6eb161780 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:07:35 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] VM Stopped (Lifecycle Event)
Apr 12 01:07:35 user nova-compute[82394]: DEBUG nova.compute.manager [None req-654e9273-2df6-4c35-ad09-8634c3cbf8d8 None None] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:07:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_power_states {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Triggering sync for uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:07:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:07:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:08 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:11 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:08:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:08:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:22 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:08:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:08:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=26.214309692382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:08:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:08:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:40 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:40 user nova-compute[82394]: INFO nova.compute.manager [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Detaching volume 8c4c55f1-8a57-483a-a660-d4f65464d462
Apr 12 01:08:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:41 user nova-compute[82394]: INFO nova.virt.block_device [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Attempting to driver detach volume 8c4c55f1-8a57-483a-a660-d4f65464d462 from mountpoint /dev/vdb
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Attempting to detach device vdb from instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:08:41 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:08:41 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:08:41 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:08:41 user nova-compute[82394]:   <serial>8c4c55f1-8a57-483a-a660-d4f65464d462</serial>
Apr 12 01:08:41 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:08:41 user nova-compute[82394]: </disk>
Apr 12 01:08:41 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:08:41 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdb from instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb from the persistent domain config.
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:08:41 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:08:41 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:08:41 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:08:41 user nova-compute[82394]:   <serial>8c4c55f1-8a57-483a-a660-d4f65464d462</serial>
Apr 12 01:08:41 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:08:41 user nova-compute[82394]: </disk>
Apr 12 01:08:41 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681261721.4754963, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:08:41 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdb from instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb from the live domain config.
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lasyVkmM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:08:41 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56a1c5-abda-40c6-8799-6044cb2183cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:08:41 user nova-compute[82394]: No targets found.
Apr 12 01:08:41 user nova-compute[82394]: iSNS:
Apr 12 01:08:41 user nova-compute[82394]: No targets found.
Apr 12 01:08:41 user nova-compute[82394]: STATIC:
Apr 12 01:08:41 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3
Apr 12 01:08:41 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:08:41 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:08:41 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462
Apr 12 01:08:41 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:08:41 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:08:41 user nova-compute[82394]: FIRMWARE:
Apr 12 01:08:41 user nova-compute[82394]: No targets found.
Apr 12 01:08:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:08:41 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:08:41 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe5e817-fd75-4a38-ba83-26ef4e19a4f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24ccd7a-77ec-403e-bd94-ede924a1e899]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3 (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:08:41 user nova-compute[82394]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3 (non-flash)
Apr 12 01:08:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 (non-flash)
Apr 12 01:08:41 user nova-compute[82394]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da96a1eb-6aba-487d-a1db-31b2660346a3 (non-flash)
Apr 12 01:08:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb234514af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758ffa6-a5cb-4562-b22e-51647807280a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7805b-847e-45fe-8ca9-4913d3f15f89]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[70af7d5f-dc82-49a5-bb7f-8ed9498c622a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e2144-9760-4ba2-a4d5-d1f37e153da6]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0271028-13cd-495e-b775-4240c24d5a44]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da23c5d-29b0-4ab3-9a28-b313e86bdd0e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260]
Apr 12 01:08:41 user nova-compute[82394]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462, portal: 172.16.0.220,3260] successful.
Apr 12 01:08:41 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c4c55f1-8a57-483a-a660-d4f65464d462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e3231-7668-4267-99e5-f5f11e5f7f6e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== disconnect_volume: return (313ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:08:41 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:08:42 user nova-compute[82394]: DEBUG nova.objects.instance [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:08:42 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82394) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.objects.instance [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.compute.manager [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:08:43 user nova-compute[82394]: WARNING nova.compute.manager [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state active and task_state powering-off.
Apr 12 01:08:43 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance destroyed successfully.
Apr 12 01:08:43 user nova-compute[82394]: DEBUG nova.compute.manager [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:08:44 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.912s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:08:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:08:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:08:45 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:08:45 user nova-compute[82394]: DEBUG nova.compute.manager [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:08:45 user nova-compute[82394]: WARNING nova.compute.manager [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state stopped and task_state None.
Apr 12 01:08:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:08:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:08:58 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261723.9902773, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:08:58 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Stopped (Lifecycle Event)
Apr 12 01:08:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1b06326f-e65d-47a8-b424-9774188d4c03 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:08:59 user nova-compute[82394]: DEBUG nova.compute.manager [None req-1b06326f-e65d-47a8-b424-9774188d4c03 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:09:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:13 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:09:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:09:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:09:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=26.204547882080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:09:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:09:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:09:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:09:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:09:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:09:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:09:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:09:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:09:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:09:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:14 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:16 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:10:22 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:10:23 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=26.20398712158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:10:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:10:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:10:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:10:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:10:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:30 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.neutron [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:10:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance destroyed successfully.
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'resources' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG os_vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcdd6d2c-92, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:34 user nova-compute[82394]: INFO os_vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start _get_guest_xml network_info=[{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:10:34 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:10:34 user nova-compute[82394]:   <uuid>9d751ef5-bdbe-4b26-9499-5e17b63de0bb</uuid>
Apr 12 01:10:34 user nova-compute[82394]:   <name>instance-0000002d</name>
Apr 12 01:10:34 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:10:34 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:10:34 user nova-compute[82394]:   <metadata>
Apr 12 01:10:34 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:10:34 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeTestJSON-server-1063618078</nova:name>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:10:34</nova:creationTime>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:10:34 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:10:34 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:owner>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:user uuid="bc8bacd3b6194651bc5820c3221ed45e">tempest-AttachVolumeTestJSON-1807582141-project-member</nova:user>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:project uuid="8c9933281dea437cbaae1040fa06ff06">tempest-AttachVolumeTestJSON-1807582141</nova:project>
Apr 12 01:10:34 user nova-compute[82394]:       </nova:owner>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:10:34 user nova-compute[82394]:       <nova:ports>
Apr 12 01:10:34 user nova-compute[82394]:         <nova:port uuid="bcdd6d2c-9283-4da8-b5b7-7f4311803431">
Apr 12 01:10:34 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 01:10:34 user nova-compute[82394]:         </nova:port>
Apr 12 01:10:34 user nova-compute[82394]:       </nova:ports>
Apr 12 01:10:34 user nova-compute[82394]:     </nova:instance>
Apr 12 01:10:34 user nova-compute[82394]:   </metadata>
Apr 12 01:10:34 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:10:34 user nova-compute[82394]:     <system>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="serial">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="uuid">9d751ef5-bdbe-4b26-9499-5e17b63de0bb</entry>
Apr 12 01:10:34 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:10:34 user nova-compute[82394]:     </system>
Apr 12 01:10:34 user nova-compute[82394]:   </sysinfo>
Apr 12 01:10:34 user nova-compute[82394]:   <os>
Apr 12 01:10:34 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:10:34 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:10:34 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:10:34 user nova-compute[82394]:   </os>
Apr 12 01:10:34 user nova-compute[82394]:   <features>
Apr 12 01:10:34 user nova-compute[82394]:     <acpi/>
Apr 12 01:10:34 user nova-compute[82394]:     <apic/>
Apr 12 01:10:34 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:10:34 user nova-compute[82394]:   </features>
Apr 12 01:10:34 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:10:34 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:10:34 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:10:34 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:10:34 user nova-compute[82394]:   </clock>
Apr 12 01:10:34 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:10:34 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:10:34 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:10:34 user nova-compute[82394]:   </cpu>
Apr 12 01:10:34 user nova-compute[82394]:   <devices>
Apr 12 01:10:34 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:10:34 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:10:34 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk"/>
Apr 12 01:10:34 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:10:34 user nova-compute[82394]:     </disk>
Apr 12 01:10:34 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:10:34 user nova-compute[82394]:       <mac address="fa:16:3e:64:31:1a"/>
Apr 12 01:10:34 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:10:34 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:10:34 user nova-compute[82394]:       <target dev="tapbcdd6d2c-92"/>
Apr 12 01:10:34 user nova-compute[82394]:     </interface>
Apr 12 01:10:34 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:10:34 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/console.log" append="off"/>
Apr 12 01:10:34 user nova-compute[82394]:     </serial>
Apr 12 01:10:34 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:10:34 user nova-compute[82394]:     <video>
Apr 12 01:10:34 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:10:34 user nova-compute[82394]:     </video>
Apr 12 01:10:34 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:10:34 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:10:34 user nova-compute[82394]:     </rng>
Apr 12 01:10:34 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:10:34 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:10:34 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:10:34 user nova-compute[82394]:     </memballoon>
Apr 12 01:10:34 user nova-compute[82394]:   </devices>
Apr 12 01:10:34 user nova-compute[82394]: </domain>
Apr 12 01:10:34 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.131s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Cannot resize image /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'migration_context' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG os_vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcdd6d2c-92, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcdd6d2c-92, col_values=(('external_ids', {'iface-id': 'bcdd6d2c-9283-4da8-b5b7-7f4311803431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:31:1a', 'vm-uuid': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:35 user nova-compute[82394]: INFO os_vif [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:10:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:10:36 user nova-compute[82394]: DEBUG nova.compute.manager [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:10:36 user nova-compute[82394]: WARNING nova.compute.manager [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:10:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:37 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261838.6383636, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:10:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Resumed (Lifecycle Event)
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:10:38 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance rebooted successfully.
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:10:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681261838.6404045, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:10:38 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Started (Lifecycle Event)
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:10:38 user nova-compute[82394]: DEBUG nova.compute.manager [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:10:38 user nova-compute[82394]: WARNING nova.compute.manager [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state active and task_state None.
Apr 12 01:10:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:10:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:10:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:14 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:14 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:11:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:11:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:11:24 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [{"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-9d751ef5-bdbe-4b26-9499-5e17b63de0bb" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:11:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:11:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=26.202533721923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:11:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:11:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:11:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:11:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:11:30 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:35 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:40 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:11:45 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:50 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:11:55 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:00 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:00 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:00 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:12:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:05 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:10 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:11 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:15 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:15 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:12:19 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:19 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:20 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:23 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:12:24 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:25 user nova-compute[82394]: INFO nova.compute.manager [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Terminating instance
Apr 12 01:12:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:12:25 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.manager [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-unplugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:12:26 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=26.20197296142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Instance destroyed successfully.
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.objects.instance [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'resources' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1063618078',display_name='tempest-AttachVolumeTestJSON-server-1063618078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1063618078',id=45,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg==',key_name='tempest-keypair-405999562',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-wi0ddycs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=9d751ef5-bdbe-4b26-9499-5e17b63de0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "address": "fa:16:3e:64:31:1a", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdd6d2c-92", "ovs_interfaceid": "bcdd6d2c-9283-4da8-b5b7-7f4311803431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG os_vif [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcdd6d2c-92, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:26 user nova-compute[82394]: INFO os_vif [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:31:1a,bridge_name='br-int',has_traffic_filtering=True,id=bcdd6d2c-9283-4da8-b5b7-7f4311803431,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdd6d2c-92')
Apr 12 01:12:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Deleting instance files /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb_del
Apr 12 01:12:26 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Deletion of /opt/stack/data/nova/instances/9d751ef5-bdbe-4b26-9499-5e17b63de0bb_del complete
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:12:26 user nova-compute[82394]: INFO nova.compute.manager [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:12:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:12:27 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Took 0.77 seconds to deallocate network for instance.
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-deleted-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:27 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Deleted allocations for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Acquiring lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Lock "9d751ef5-bdbe-4b26-9499-5e17b63de0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:12:27 user nova-compute[82394]: DEBUG nova.compute.manager [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] No waiting events found dispatching network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:12:27 user nova-compute[82394]: WARNING nova.compute.manager [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Received unexpected event network-vif-plugged-bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance with vm_state deleted and task_state None.
Apr 12 01:12:30 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:12:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:41 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681261945.9627023, 9d751ef5-bdbe-4b26-9499-5e17b63de0bb => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:12:41 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] VM Stopped (Lifecycle Event)
Apr 12 01:12:41 user nova-compute[82394]: DEBUG nova.compute.manager [None req-b4cfa5a0-5c2f-46a1-a147-b42bfa33866b None None] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:12:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:12:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:12:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:17 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Starting instance... {{(pid=82394) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82394) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:13:19 user nova-compute[82394]: INFO nova.compute.claims [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Claim successful on node user
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Start building networks asynchronously for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Allocating IP information in the background. {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] allocate_for_instance() {{(pid=82394) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:13:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Start building block device mappings for instance. {{(pid=82394) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.policy [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82394) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Start spawning the instance on the hypervisor. {{(pid=82394) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Creating instance directory {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:13:19 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Creating image(s)
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "/opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "/opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "/opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "af28a99db336a2589fefead5323483e479274997" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "af28a99db336a2589fefead5323483e479274997" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:19 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.132s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk 1073741824 {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997,backing_fmt=raw /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk 1073741824" returned: 0 in 0.049s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "af28a99db336a2589fefead5323483e479274997" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af28a99db336a2589fefead5323483e479274997 --force-share --output=json" returned: 0 in 0.139s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk. size=1073741824 {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Successfully created port: 978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.virt.disk.api [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Cannot resize image /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk to a smaller size. {{(pid=82394) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.objects.instance [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'migration_context' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Created local disks {{(pid=82394) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Ensure instance console log exists: /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/console.log {{(pid=82394) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Successfully updated port: 978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Building network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-changed-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.compute.manager [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Refreshing instance network info cache due to event network-changed-978785eb-1a68-4a8b-8417-66e0a8b13937. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Instance cache missing network info. {{(pid=82394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Instance network_info: |[{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82394) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Refreshing network info cache for port 978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Start _get_guest_xml network_info=[{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:13:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:13:21 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82394) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T00:27:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T00:26:05Z,direct_url=<?>,disk_format='qcow2',id=7ae54858-7fe8-4bde-be8c-1b0f88b691ea,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='013156ef7e1849449f7481670a064c58',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T00:26:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Got 1 possible topologies {{(pid=82394) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82394) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-717569489',display_name='tempest-AttachVolumeTestJSON-server-717569489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-717569489',id=47,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnQ81yiH2IPtrrq5dVXYilo1OCQ+NjEjsGj2vbhpQk8OCME5dD4DDx8chQjke0l7IHjohX8YSoXjWERAWr2t9d5s5rwogAKtGecdi2acJpjCBHGA2Dq+V0nRhsccXfCMw==',key_name='tempest-keypair-1597493578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-789yxik0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:13:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=72a31d24-b6f0-4a08-bdab-b16e23127053,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82394) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'pci_devices' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:13:21 user nova-compute[82394]:   <uuid>72a31d24-b6f0-4a08-bdab-b16e23127053</uuid>
Apr 12 01:13:21 user nova-compute[82394]:   <name>instance-0000002f</name>
Apr 12 01:13:21 user nova-compute[82394]:   <memory>131072</memory>
Apr 12 01:13:21 user nova-compute[82394]:   <vcpu>1</vcpu>
Apr 12 01:13:21 user nova-compute[82394]:   <metadata>
Apr 12 01:13:21 user nova-compute[82394]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:13:21 user nova-compute[82394]:       <nova:package version="0.0.0"/>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:name>tempest-AttachVolumeTestJSON-server-717569489</nova:name>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:creationTime>2023-04-12 01:13:21</nova:creationTime>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:flavor name="m1.nano">
Apr 12 01:13:21 user nova-compute[82394]:         <nova:memory>128</nova:memory>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:disk>1</nova:disk>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:swap>0</nova:swap>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:13:21 user nova-compute[82394]:       </nova:flavor>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:owner>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:user uuid="bc8bacd3b6194651bc5820c3221ed45e">tempest-AttachVolumeTestJSON-1807582141-project-member</nova:user>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:project uuid="8c9933281dea437cbaae1040fa06ff06">tempest-AttachVolumeTestJSON-1807582141</nova:project>
Apr 12 01:13:21 user nova-compute[82394]:       </nova:owner>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:root type="image" uuid="7ae54858-7fe8-4bde-be8c-1b0f88b691ea"/>
Apr 12 01:13:21 user nova-compute[82394]:       <nova:ports>
Apr 12 01:13:21 user nova-compute[82394]:         <nova:port uuid="978785eb-1a68-4a8b-8417-66e0a8b13937">
Apr 12 01:13:21 user nova-compute[82394]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 01:13:21 user nova-compute[82394]:         </nova:port>
Apr 12 01:13:21 user nova-compute[82394]:       </nova:ports>
Apr 12 01:13:21 user nova-compute[82394]:     </nova:instance>
Apr 12 01:13:21 user nova-compute[82394]:   </metadata>
Apr 12 01:13:21 user nova-compute[82394]:   <sysinfo type="smbios">
Apr 12 01:13:21 user nova-compute[82394]:     <system>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="version">0.0.0</entry>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="serial">72a31d24-b6f0-4a08-bdab-b16e23127053</entry>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="uuid">72a31d24-b6f0-4a08-bdab-b16e23127053</entry>
Apr 12 01:13:21 user nova-compute[82394]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:13:21 user nova-compute[82394]:     </system>
Apr 12 01:13:21 user nova-compute[82394]:   </sysinfo>
Apr 12 01:13:21 user nova-compute[82394]:   <os>
Apr 12 01:13:21 user nova-compute[82394]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:13:21 user nova-compute[82394]:     <boot dev="hd"/>
Apr 12 01:13:21 user nova-compute[82394]:     <smbios mode="sysinfo"/>
Apr 12 01:13:21 user nova-compute[82394]:   </os>
Apr 12 01:13:21 user nova-compute[82394]:   <features>
Apr 12 01:13:21 user nova-compute[82394]:     <acpi/>
Apr 12 01:13:21 user nova-compute[82394]:     <apic/>
Apr 12 01:13:21 user nova-compute[82394]:     <vmcoreinfo/>
Apr 12 01:13:21 user nova-compute[82394]:   </features>
Apr 12 01:13:21 user nova-compute[82394]:   <clock offset="utc">
Apr 12 01:13:21 user nova-compute[82394]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:13:21 user nova-compute[82394]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:13:21 user nova-compute[82394]:     <timer name="hpet" present="no"/>
Apr 12 01:13:21 user nova-compute[82394]:   </clock>
Apr 12 01:13:21 user nova-compute[82394]:   <cpu mode="custom" match="exact">
Apr 12 01:13:21 user nova-compute[82394]:     <model>Nehalem</model>
Apr 12 01:13:21 user nova-compute[82394]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:13:21 user nova-compute[82394]:   </cpu>
Apr 12 01:13:21 user nova-compute[82394]:   <devices>
Apr 12 01:13:21 user nova-compute[82394]:     <disk type="file" device="disk">
Apr 12 01:13:21 user nova-compute[82394]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:13:21 user nova-compute[82394]:       <source file="/opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk"/>
Apr 12 01:13:21 user nova-compute[82394]:       <target dev="vda" bus="virtio"/>
Apr 12 01:13:21 user nova-compute[82394]:     </disk>
Apr 12 01:13:21 user nova-compute[82394]:     <interface type="ethernet">
Apr 12 01:13:21 user nova-compute[82394]:       <mac address="fa:16:3e:80:38:bc"/>
Apr 12 01:13:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:13:21 user nova-compute[82394]:       <mtu size="1442"/>
Apr 12 01:13:21 user nova-compute[82394]:       <target dev="tap978785eb-1a"/>
Apr 12 01:13:21 user nova-compute[82394]:     </interface>
Apr 12 01:13:21 user nova-compute[82394]:     <serial type="pty">
Apr 12 01:13:21 user nova-compute[82394]:       <log file="/opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/console.log" append="off"/>
Apr 12 01:13:21 user nova-compute[82394]:     </serial>
Apr 12 01:13:21 user nova-compute[82394]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:13:21 user nova-compute[82394]:     <video>
Apr 12 01:13:21 user nova-compute[82394]:       <model type="virtio"/>
Apr 12 01:13:21 user nova-compute[82394]:     </video>
Apr 12 01:13:21 user nova-compute[82394]:     <rng model="virtio">
Apr 12 01:13:21 user nova-compute[82394]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:13:21 user nova-compute[82394]:     </rng>
Apr 12 01:13:21 user nova-compute[82394]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:13:21 user nova-compute[82394]:     <memballoon model="virtio">
Apr 12 01:13:21 user nova-compute[82394]:       <stats period="10"/>
Apr 12 01:13:21 user nova-compute[82394]:     </memballoon>
Apr 12 01:13:21 user nova-compute[82394]:   </devices>
Apr 12 01:13:21 user nova-compute[82394]: </domain>
Apr 12 01:13:21 user nova-compute[82394]:  {{(pid=82394) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-717569489',display_name='tempest-AttachVolumeTestJSON-server-717569489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-717569489',id=47,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnQ81yiH2IPtrrq5dVXYilo1OCQ+NjEjsGj2vbhpQk8OCME5dD4DDx8chQjke0l7IHjohX8YSoXjWERAWr2t9d5s5rwogAKtGecdi2acJpjCBHGA2Dq+V0nRhsccXfCMw==',key_name='tempest-keypair-1597493578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-789yxik0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:13:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=72a31d24-b6f0-4a08-bdab-b16e23127053,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG os_vif [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a') {{(pid=82394) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap978785eb-1a, may_exist=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap978785eb-1a, col_values=(('external_ids', {'iface-id': '978785eb-1a68-4a8b-8417-66e0a8b13937', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:38:bc', 'vm-uuid': '72a31d24-b6f0-4a08-bdab-b16e23127053'}),)) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:21 user nova-compute[82394]: INFO os_vif [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a')
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No VIF found with MAC fa:16:3e:80:38:bc, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updated VIF entry in instance network info cache for port 978785eb-1a68-4a8b-8417-66e0a8b13937. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG nova.network.neutron [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:13:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:13:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:22 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG nova.compute.manager [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] No waiting events found dispatching network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:13:23 user nova-compute[82394]: WARNING nova.compute.manager [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received unexpected event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 for instance with vm_state building and task_state spawning.
Apr 12 01:13:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:23 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] No waiting events found dispatching network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:13:25 user nova-compute[82394]: WARNING nova.compute.manager [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received unexpected event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 for instance with vm_state building and task_state spawning.
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681262005.1815574, 72a31d24-b6f0-4a08-bdab-b16e23127053 => Resumed> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] VM Resumed (Lifecycle Event)
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Instance event wait completed in 0 seconds for  {{(pid=82394) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Guest created on hypervisor {{(pid=82394) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Instance spawned successfully.
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_cdrom_bus of ide {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_disk_bus of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_input_bus of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_pointer_model of None {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_video_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Found default for hw_vif_model of virtio {{(pid=82394) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.virt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Emitting event <LifecycleEvent: 1681262005.1831298, 72a31d24-b6f0-4a08-bdab-b16e23127053 => Started> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] VM Started (Lifecycle Event)
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82394) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:13:25 user nova-compute[82394]: INFO nova.compute.manager [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Took 6.04 seconds to build instance.
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.146s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:13:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:13:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:13:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:13:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=26.219890594482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:13:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:13:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:13:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:13:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:13 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:18 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:14:25 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:14:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:14:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:14:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=26.19965362548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:14:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:14:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:36 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:14:41 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:46 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:51 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:14:56 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:01 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:06 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-changed-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG nova.compute.manager [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Refreshing instance network info cache due to event network-changed-978785eb-1a68-4a8b-8417-66e0a8b13937. {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Refreshing network info cache for port 978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updated VIF entry in instance network info cache for port 978785eb-1a68-4a8b-8417-66e0a8b13937. {{(pid=82394) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG nova.network.neutron [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:15:10 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:11 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:12 user nova-compute[82394]: INFO nova.compute.manager [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attaching volume 7e5f6748-3a26-48ee-bd0b-af4ab486825d to /dev/vdb
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72583f3f-9381-406b-b0e8-e3326247034e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4b0d2-014c-4de1-bd98-beb26a40b142]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c1e81-51d0-4b7a-92b8-fb685a7400c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c243a42-bb30-4b7e-a362-7824a30f8b24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:15:12 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:15:12 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dea534f-0db9-474f-8a78-eb932341b980]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG os_brick.utils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:12 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating existing volume attachment record: 4d9d703d-720a-4a39-84d6-844ed683de77 {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:15:15 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:16 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kihKdqxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:17 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f9bcc-b9fa-4412-8f5e-017b4be799e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:15:17 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3110062f-2291-4e31-9e55-5bf6d0094eb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d] added
Apr 12 01:15:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa31748-3f53-4afd-9f7a-80b701ca840a]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[46deb149-f669-4569-bf00-1428d055fc7b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kihKdqxN {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kihKdqxN" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677ba41-c193-41a6-a081-784fa448e919]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kihKdqxN'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab8b8d9-402c-4a64-a3dd-af1b82e1841d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9dc2d4-529a-4130-bdd9-e66f52f80eb9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:15:17 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:15:17 user nova-compute[82394]:  {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:17 user nova-compute[82394]: WARNING os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:15:17 user nova-compute[82394]: 
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[701942a6-45db-4060-98cb-341b93dc2f2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260]
Apr 12 01:15:17 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260] successful.
Apr 12 01:15:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e5024b-aa50-4516-b9df-1cb8182eccab]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0ddcc3-af6a-47b8-abe8-b352f425787e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:17 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a0d28-078a-45aa-a22d-c595ecabfb5e]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:15:17 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kihKdqxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26264346464306232', 'path': '/dev/sdb'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264346464306232', 'path': '/dev/sdb'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.objects.instance [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:15:18 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:18 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:15:18 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:15:18 user nova-compute[82394]:   <serial>7e5f6748-3a26-48ee-bd0b-af4ab486825d</serial>
Apr 12 01:15:18 user nova-compute[82394]: </disk>
Apr 12 01:15:18 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No VIF found with MAC fa:16:3e:80:38:bc, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:15:18 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.910s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:20 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:20 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:21 user nova-compute[82394]: INFO nova.compute.manager [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attaching volume 7a9226ef-a2fc-49ca-b581-7c37a88e7b9d to /dev/vdc
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.utils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2cbb1-b46b-487d-8829-5937e2e7cbf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5034745d92f8\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619bf90-3d20-4ecf-b068-20bf28e51abf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6a8776-c3d7-48d6-a199-d17d43357ed1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49cc48c-3c1d-4d65-8894-a89d065641f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Running cmd (subprocess): nvme version {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 'nvme version' failed. Not Retrying. {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] nvme not present on system {{(pid=82394) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:15:21 user nova-compute[82394]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829d236-2882-4262-ba65-bc5910a7927d]: (4, '') {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82394) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.lightos [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] LIGHTOS: no hostnqn found. {{(pid=82394) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG os_brick.utils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5034745d92f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG nova.virt.block_device [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating existing volume attachment record: 61c78e4c-41cf-4325-97ba-81887dbcac1d {{(pid=82394) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:15:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Calling os-brick to attach iSCSI Volume {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJadYjsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:25 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:25 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:25 user nova-compute[82394]: INFO os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[e897cfa1-5539-41cb-b214-f3722074b51b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:15:25 user nova-compute[82394]:  {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --interface default --op new {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[631c66fd-afd8-41db-93d0-e9c023216d9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d] added\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d] added
Apr 12 01:15:25 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1315415d-9743-4b49-9d1b-959e0e4cedb2]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa8c947-4811-4a25-8be0-5fa8fd73047f]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJadYjsu {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJadYjsu" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27fa09-1cca-4a6b-8393-00cd27a2f128]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJadYjsu'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad1c16e-2c85-4485-b93c-4ddac7bf603d]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:25 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[72432abe-5bc4-467a-9031-089f3af61de1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --login {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d8ede-b27e-40db-b04b-a7c1f74098cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260]
Apr 12 01:15:26 user nova-compute[82394]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260] successful.
Apr 12 01:15:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[03973ed4-789b-47d7-baac-4c06dd80db6e]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e198f-bf24-4093-99be-160c0ae6795c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:26 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to 172.16.0.220:3260 {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=82394) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82394) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a514d-a621-449a-beef-c2f451e02f4f]: (4, ('- - 0', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82394) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJadYjsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82394) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:15:26 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26334376131326539', 'path': '/dev/sdc'} {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334376131326539', 'path': '/dev/sdc'} {{(pid=82394) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.objects.instance [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:15:27 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:27 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:15:27 user nova-compute[82394]:   <target dev="vdc" bus="virtio"/>
Apr 12 01:15:27 user nova-compute[82394]:   <serial>7a9226ef-a2fc-49ca-b581-7c37a88e7b9d</serial>
Apr 12 01:15:27 user nova-compute[82394]: </disk>
Apr 12 01:15:27 user nova-compute[82394]:  {{(pid=82394) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82394) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82394) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:15:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:15:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=26.19849395751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vda, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82394) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] No VIF found with MAC fa:16:3e:80:38:bc, not building metadata {{(pid=82394) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82394) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.409s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:28 user nova-compute[82394]: INFO nova.compute.manager [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Detaching volume 7e5f6748-3a26-48ee-bd0b-af4ab486825d
Apr 12 01:15:28 user nova-compute[82394]: INFO nova.virt.block_device [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attempting to driver detach volume 7e5f6748-3a26-48ee-bd0b-af4ab486825d from mountpoint /dev/vdb
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Attempting to detach device vdb from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:15:28 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:28 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:15:28 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:15:28 user nova-compute[82394]:   <serial>7e5f6748-3a26-48ee-bd0b-af4ab486825d</serial>
Apr 12 01:15:28 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:15:28 user nova-compute[82394]: </disk>
Apr 12 01:15:28 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:15:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdb from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the persistent domain config.
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:15:28 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:28 user nova-compute[82394]:   <source dev="/dev/sdb"/>
Apr 12 01:15:28 user nova-compute[82394]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:15:28 user nova-compute[82394]:   <serial>7e5f6748-3a26-48ee-bd0b-af4ab486825d</serial>
Apr 12 01:15:28 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:15:28 user nova-compute[82394]: </disk>
Apr 12 01:15:28 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681262128.8439262, 72a31d24-b6f0-4a08-bdab-b16e23127053 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:15:28 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdb from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the live domain config.
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kihKdqxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:28 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb547e01-fccf-4e54-82ed-5306dde82294]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:15:28 user nova-compute[82394]: No targets found.
Apr 12 01:15:28 user nova-compute[82394]: iSNS:
Apr 12 01:15:28 user nova-compute[82394]: No targets found.
Apr 12 01:15:28 user nova-compute[82394]: STATIC:
Apr 12 01:15:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d
Apr 12 01:15:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:15:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:15:28 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d
Apr 12 01:15:28 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:15:28 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:15:28 user nova-compute[82394]: FIRMWARE:
Apr 12 01:15:28 user nova-compute[82394]: No targets found.
Apr 12 01:15:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:15:28 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:15:28 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquired lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Forcefully refreshing network info cache for instance {{(pid=82394) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG nova.objects.instance [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lazy-loading 'info_cache' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[6822eb14-5752-4131-ac0e-4d0f2e3bcb68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3948f7-3325-4a86-898d-f5867718c4a7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:28 user nova-compute[82394]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d (non-flash)
Apr 12 01:15:28 user nova-compute[82394]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:28 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2343cd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d'): ({'sdb'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Removing single pathed devices sdb {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2e25f-4367-4bc7-bc97-f75dec6cd5d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e3ccb-9f64-4d11-a702-4ec3bc45dba5]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flushing IO for device /dev/sdb {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:15:28 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[66914b33-cf38-48e6-8067-6ba1a97edbec]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fa2ee-5e3e-47fe-8498-7bea51331f38]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] SCSI volumes sdb have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb53d913-020d-4e0f-9686-eb69c076af70]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68bcbc5-d25b-485e-82ec-c22064db917a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260]
Apr 12 01:15:29 user nova-compute[82394]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d, portal: 172.16.0.220,3260] successful.
Apr 12 01:15:29 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5f6748-3a26-48ee-bd0b-af4ab486825d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[03addb5e-1b15-4196-887a-b2a49db3b9ea]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== disconnect_volume: return (301ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG nova.network.neutron [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [{"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Releasing lock "refresh_cache-72a31d24-b6f0-4a08-bdab-b16e23127053" {{(pid=82394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updated the network info_cache for instance {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG nova.objects.instance [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:30 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:30 user nova-compute[82394]: INFO nova.compute.manager [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Detaching volume 7a9226ef-a2fc-49ca-b581-7c37a88e7b9d
Apr 12 01:15:30 user nova-compute[82394]: INFO nova.virt.block_device [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Attempting to driver detach volume 7a9226ef-a2fc-49ca-b581-7c37a88e7b9d from mountpoint /dev/vdc
Apr 12 01:15:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Attempting to detach device vdc from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the persistent domain config. {{(pid=82394) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:15:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:15:30 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:30 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:15:30 user nova-compute[82394]:   <target dev="vdc" bus="virtio"/>
Apr 12 01:15:30 user nova-compute[82394]:   <serial>7a9226ef-a2fc-49ca-b581-7c37a88e7b9d</serial>
Apr 12 01:15:30 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 01:15:30 user nova-compute[82394]: </disk>
Apr 12 01:15:30 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:15:30 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdc from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the persistent domain config.
Apr 12 01:15:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the live domain config. {{(pid=82394) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:15:30 user nova-compute[82394]: DEBUG nova.virt.libvirt.guest [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:15:30 user nova-compute[82394]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:15:30 user nova-compute[82394]:   <source dev="/dev/sdc"/>
Apr 12 01:15:30 user nova-compute[82394]:   <target dev="vdc" bus="virtio"/>
Apr 12 01:15:30 user nova-compute[82394]:   <serial>7a9226ef-a2fc-49ca-b581-7c37a88e7b9d</serial>
Apr 12 01:15:30 user nova-compute[82394]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 01:15:30 user nova-compute[82394]: </disk>
Apr 12 01:15:30 user nova-compute[82394]:  {{(pid=82394) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-f2630563-3227-4c25-a5c5-f9f6166fc554 None None] Received event <DeviceRemovedEvent: 1681262131.2618427, 72a31d24-b6f0-4a08-bdab-b16e23127053 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82394) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.driver [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:15:31 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully detached device vdc from instance 72a31d24-b6f0-4a08-bdab-b16e23127053 from the live domain config.
Apr 12 01:15:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] calling os-brick to detach iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb243c3e920>, {'target_iqn': 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJadYjsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:15:31 user nova-compute[82394]: WARNING os_brick.initiator.connectors.base [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b49abb5-07d1-41c0-aa93-d2bae43827da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:15:31 user nova-compute[82394]: No targets found.
Apr 12 01:15:31 user nova-compute[82394]: iSNS:
Apr 12 01:15:31 user nova-compute[82394]: No targets found.
Apr 12 01:15:31 user nova-compute[82394]: STATIC:
Apr 12 01:15:31 user nova-compute[82394]: Target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d
Apr 12 01:15:31 user nova-compute[82394]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:15:31 user nova-compute[82394]:                 Iface Name: default
Apr 12 01:15:31 user nova-compute[82394]: FIRMWARE:
Apr 12 01:15:31 user nova-compute[82394]: No targets found.
Apr 12 01:15:31 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:15:31 user nova-compute[82394]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:15:31 user nova-compute[82394]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82394) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d', 0)] {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4ebae-74eb-4089-84f3-a770d16a0ee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[24daf8b3-0e55-454f-82da-ec788b4a2d2b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:31 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d (non-flash)
Apr 12 01:15:31 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2142d4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d'): ({'sdc'}, set())}) {{(pid=82394) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Removing single pathed devices sdc {{(pid=82394) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0662991-249d-41e1-9bff-d8f0a7e3b41d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3dc756-2d6b-4f5b-a805-ed376b7e2e7d]: (4, ('ok\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flushing IO for device /dev/sdc {{(pid=82394) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb518c-7cec-4b0c-a2f1-73223240725b]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82394) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[8084622c-93d4-4074-a4a1-07befa7939bf]: (4, ('1', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.linuxscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] SCSI volumes sdc have been removed. {{(pid=82394) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d')] {{(pid=82394) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[04189068-516e-4a08-a780-39787f0ddd06]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --logout {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3843b5a-8031-4c96-a7c4-987b94694b12]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260]
Apr 12 01:15:31 user nova-compute[82394]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d, portal: 172.16.0.220,3260] successful.
Apr 12 01:15:31 user nova-compute[82394]:  stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op delete {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9226ef-a2fc-49ca-b581-7c37a88e7b9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fcfb7-356c-4526-9267-b41174cfc5a8]: (4, ('', '')) {{(pid=92359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82394) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.base [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG os_brick.initiator.connectors.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] <== disconnect_volume: return (279ms) None {{(pid=82394) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:15:31 user nova-compute[82394]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Disconnected iSCSI Volume {{(pid=82394) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:15:32 user nova-compute[82394]: DEBUG nova.objects.instance [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'flavor' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:32 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:33 user nova-compute[82394]: INFO nova.compute.manager [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Terminating instance
Apr 12 01:15:33 user nova-compute[82394]: DEBUG nova.compute.manager [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Start destroying the instance on the hypervisor. {{(pid=82394) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-unplugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] No waiting events found dispatching network-vif-unplugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:15:33 user nova-compute[82394]: DEBUG nova.compute.manager [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-unplugged-978785eb-1a68-4a8b-8417-66e0a8b13937 for instance with task_state deleting. {{(pid=82394) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Instance destroyed successfully.
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.objects.instance [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'resources' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=82394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.virt.libvirt.vif [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-717569489',display_name='tempest-AttachVolumeTestJSON-server-717569489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-717569489',id=47,image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnQ81yiH2IPtrrq5dVXYilo1OCQ+NjEjsGj2vbhpQk8OCME5dD4DDx8chQjke0l7IHjohX8YSoXjWERAWr2t9d5s5rwogAKtGecdi2acJpjCBHGA2Dq+V0nRhsccXfCMw==',key_name='tempest-keypair-1597493578',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c9933281dea437cbaae1040fa06ff06',ramdisk_id='',reservation_id='r-789yxik0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807582141',owner_user_name='tempest-AttachVolumeTestJSON-1807582141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8bacd3b6194651bc5820c3221ed45e',uuid=72a31d24-b6f0-4a08-bdab-b16e23127053,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converting VIF {"id": "978785eb-1a68-4a8b-8417-66e0a8b13937", "address": "fa:16:3e:80:38:bc", "network": {"id": "82994dcf-29f7-4699-a7ae-6ea95516c04f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-580354950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c9933281dea437cbaae1040fa06ff06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978785eb-1a", "ovs_interfaceid": "978785eb-1a68-4a8b-8417-66e0a8b13937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.network.os_vif_util [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a') {{(pid=82394) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG os_vif [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a') {{(pid=82394) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap978785eb-1a, bridge=br-int, if_exists=True) {{(pid=82394) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:34 user nova-compute[82394]: INFO os_vif [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:38:bc,bridge_name='br-int',has_traffic_filtering=True,id=978785eb-1a68-4a8b-8417-66e0a8b13937,network=Network(82994dcf-29f7-4699-a7ae-6ea95516c04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978785eb-1a')
Apr 12 01:15:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Deleting instance files /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053_del
Apr 12 01:15:34 user nova-compute[82394]: INFO nova.virt.libvirt.driver [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Deletion of /opt/stack/data/nova/instances/72a31d24-b6f0-4a08-bdab-b16e23127053_del complete
Apr 12 01:15:34 user nova-compute[82394]: INFO nova.compute.manager [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 01:15:34 user nova-compute[82394]: DEBUG oslo.service.loopingcall [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82394) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.compute.manager [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Deallocating network for instance {{(pid=82394) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:15:34 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] deallocate_for_instance() {{(pid=82394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.network.neutron [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Updating instance_info_cache with network_info: [] {{(pid=82394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:15:35 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Took 0.82 seconds to deallocate network for instance.
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-deleted-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:35 user nova-compute[82394]: INFO nova.scheduler.client.report [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Deleted allocations for instance 72a31d24-b6f0-4a08-bdab-b16e23127053
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Acquiring lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Lock "72a31d24-b6f0-4a08-bdab-b16e23127053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:15:35 user nova-compute[82394]: DEBUG nova.compute.manager [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] No waiting events found dispatching network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 {{(pid=82394) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:15:35 user nova-compute[82394]: WARNING nova.compute.manager [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Received unexpected event network-vif-plugged-978785eb-1a68-4a8b-8417-66e0a8b13937 for instance with vm_state deleted and task_state None.
Apr 12 01:15:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:15:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:49 user nova-compute[82394]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681262134.1685884, 72a31d24-b6f0-4a08-bdab-b16e23127053 => Stopped> {{(pid=82394) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:15:49 user nova-compute[82394]: INFO nova.compute.manager [-] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] VM Stopped (Lifecycle Event)
Apr 12 01:15:49 user nova-compute[82394]: DEBUG nova.compute.manager [None req-6ab0ee4c-5a50-4596-9733-0c9b96d1a039 None None] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Checking state {{(pid=82394) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:15:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:15:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:15:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:17 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:21 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:16:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:24 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:16:26 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:16:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:16:27 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=26.217025756835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing inventories for resource provider d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating ProviderTree inventory for provider d7e79abf-0487-4aad-a897-f0694d34c558 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Updating inventory in ProviderTree for provider d7e79abf-0487-4aad-a897-f0694d34c558 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing aggregate associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, aggregates: None {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Refreshing trait associations for resource provider d7e79abf-0487-4aad-a897-f0694d34c558, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=82394) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:16:27 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:16:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:16:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:16:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:16:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:32 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:16:32 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] There are 0 instances to clean {{(pid=82394) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:16:32 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:33 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:33 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:16:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:44 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:49 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:16:54 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:16:59 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:17:04 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:06 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:06 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Cleaning up deleted instances with incomplete migration  {{(pid=82394) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:17:09 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82394) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82394) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:17:14 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:18 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:19 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:21 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:22 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:22 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82394) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:17:24 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:25 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:27 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Starting heal instance info cache {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Rebuilding the list of instances to heal {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG nova.compute.manager [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Didn't find any instances for network info cache update. {{(pid=82394) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager.update_available_resource {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:17:28 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Auditing locally available compute resources for user (node: user) {{(pid=82394) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:17:29 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:17:29 user nova-compute[82394]: WARNING nova.virt.libvirt.driver [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=26.2060546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82394) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82394) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.compute.provider_tree [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed in ProviderTree for provider: d7e79abf-0487-4aad-a897-f0694d34c558 {{(pid=82394) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.scheduler.client.report [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Inventory has not changed for provider d7e79abf-0487-4aad-a897-f0694d34c558 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82394) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG nova.compute.resource_tracker [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Compute_service record updated for user:user {{(pid=82394) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:17:29 user nova-compute[82394]: DEBUG oslo_concurrency.lockutils [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=82394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:17:34 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:17:36 user nova-compute[82394]: DEBUG oslo_service.periodic_task [None req-9f0a81cc-c7f5-48d5-af32-b22d3aafc07e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82394) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:17:39 user nova-compute[82394]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82394) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}